-- Logs begin at Sun 2022-10-23 01:33:25 UTC, end at Sun 2022-10-23 02:25:52 UTC. -- Oct 23 01:57:36.921928 dv-cinder-861491-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 23 01:57:36.932908 dv-cinder-861491-5-smb devstack@keystone.service[81600]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 01:57:36 2022] *** Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: nodename: dv-cinder-861491-5-smb Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: machine: x86_64 Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: clock source: unix Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: pcre jit disabled Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: detected number of CPU cores: 4 Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: current working directory: / Oct 23 01:57:36.935533 dv-cinder-861491-5-smb devstack@keystone.service[81600]: detected binary path: /usr/bin/uwsgi-core Oct 23 01:57:36.936172 dv-cinder-861491-5-smb devstack@keystone.service[81600]: your processes number limit is 47680 Oct 23 01:57:36.936172 dv-cinder-861491-5-smb devstack@keystone.service[81600]: your memory page size is 4096 bytes Oct 23 01:57:36.936172 dv-cinder-861491-5-smb devstack@keystone.service[81600]: detected max file descriptor number: 2048 Oct 23 01:57:36.936172 dv-cinder-861491-5-smb devstack@keystone.service[81600]: lock engine: pthread robust mutexes Oct 23 01:57:36.936172 dv-cinder-861491-5-smb devstack@keystone.service[81600]: thunder lock: enabled Oct 23 01:57:36.936172 dv-cinder-861491-5-smb devstack@keystone.service[81600]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 23 01:57:36.936172 dv-cinder-861491-5-smb devstack@keystone.service[81600]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 01:57:36.975007 dv-cinder-861491-5-smb devstack@keystone.service[81600]: Python main interpreter initialized at 0x55bcac4199c0 Oct 23 01:57:36.975007 dv-cinder-861491-5-smb devstack@keystone.service[81600]: python threads support enabled Oct 23 01:57:36.975007 dv-cinder-861491-5-smb devstack@keystone.service[81600]: your server socket listen backlog is limited to 100 connections Oct 23 01:57:36.975007 dv-cinder-861491-5-smb devstack@keystone.service[81600]: your mercy for graceful operations on workers is 90 seconds Oct 23 01:57:36.975327 dv-cinder-861491-5-smb devstack@keystone.service[81600]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 01:57:36.975427 dv-cinder-861491-5-smb devstack@keystone.service[81600]: *** Operational MODE: preforking *** Oct 23 01:57:36.975690 dv-cinder-861491-5-smb devstack@keystone.service[81600]: *** uWSGI is running in multiple interpreter mode *** Oct 23 01:57:36.975690 dv-cinder-861491-5-smb devstack@keystone.service[81600]: spawned uWSGI master process (pid: 81600) Oct 23 01:57:36.976126 dv-cinder-861491-5-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 23 01:57:36.979732 dv-cinder-861491-5-smb devstack@keystone.service[81600]: spawned uWSGI worker 1 (pid: 81612, cores: 1) Oct 23 01:57:36.979732 dv-cinder-861491-5-smb devstack@keystone.service[81600]: spawned uWSGI worker 2 (pid: 81613, cores: 1) Oct 23 01:57:36.979732 dv-cinder-861491-5-smb devstack@keystone.service[81600]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 01:57:41.261842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:57:41.261842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Oct 23 01:57:41.262635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:57:41.262635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Oct 23 01:57:41.265700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:57:41.265700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: from cryptography.utils import int_from_bytes Oct 23 01:57:41.266165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 01:57:41.266165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: from cryptography.utils import int_from_bytes Oct 23 01:57:41.312074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 01:57:41.312263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 01:57:41.312454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] command line args: [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 01:57:41.312721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 01:57:41.312897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ================================================================================ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 01:57:41.313176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.313421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_dir = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.313606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.313824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_source = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.314008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] debug = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.314205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.314451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 01:57:41.314625 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.314716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 01:57:41.314785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.314845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] command line args: [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 01:57:41.315006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 01:57:41.315232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ================================================================================ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 01:57:41.315316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] admin_token = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_config_append = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_dir = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.315952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_dir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_source = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] debug = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.316920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_config_append = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.317930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_dir = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.318944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319185 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.319923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] publish_errors = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.320932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] standard_threads = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.321867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_journal = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] publish_errors = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_json = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_stderr = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_syslog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.322932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.323016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.323184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.323271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.323408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.323490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.323665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.323745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] standard_threads = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.323900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.323992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.324143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.324225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.324322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.324406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.324502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_journal = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.324604 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.324693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_json = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.324837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.324922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_stderr = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.325042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_syslog = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.325131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.325278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 01:57:41.325368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.325534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.325617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.325778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.325862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.326968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.327945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.328920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.329125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.329205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.329819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.329904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330076 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.330922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.331861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.332956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.333969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.334912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.335966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.336964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.337918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.338992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.339931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.340954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.341921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.342863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.343952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344185 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.344890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.345039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.345698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.345781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.345937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.346944 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.347870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348495 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.348823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.external = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.349928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.350013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.350163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.350248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.350408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.350488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.password = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.350646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.token = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.350733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.351933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.external = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.352873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.password = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.token = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.353869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.354984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.355954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.356916 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.357988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.358954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.359909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.360883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.361992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.362930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.363971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.364914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365395 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.365871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366118 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.366991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.367924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368231 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.368935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.369946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.370900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.371991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.372949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.373911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.374965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.375969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.376952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.377996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.378948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379099 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.379882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.380996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.381946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.382958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.383986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.384861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.385994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.386970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.387980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.388990 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.389960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390719 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.390950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.391101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.391189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.391333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.391413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.391566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.391645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.392381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.392484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.392561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.392633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.392800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.392881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.393874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394731 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.394969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.395952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.396912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.397949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.398900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.399988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.400069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.400225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.400305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.400455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.400534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.400615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 01:57:41.400691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.400929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.401191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.401440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.401677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.401924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.402160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.402412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.402651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.402896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.403135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.403378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.403614 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 01:57:41.403786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 01:57:41.429868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.430098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.430318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.432368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.432606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.432832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.438553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.441138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.466675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.466907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.467196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.467432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.520078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.520726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.568617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.568849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.569912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.570150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.722665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.722895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723572 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.723927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.724143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.724357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.747396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.747602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.747688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.747835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.747934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.748896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.759830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.759929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.772438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.772623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.772711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.772857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.772941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.773973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 01:57:41.791055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.791268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 01:57:41.791353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.791512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 01:57:41.791619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.791823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 01:57:41.791920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.792030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 01:57:41.792112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.792307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.792390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.792567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.792650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.792825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.792905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.793105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.803065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.803201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.803350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.803507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.803634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.803760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.803918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.804006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.810933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.811028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.814377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.814482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.814660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.814744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.814940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.815024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.815219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.815312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.815496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.815580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.815754 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.815837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.816914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.817120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.817206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.840120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.840434 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.841606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.841889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.841971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.842201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.846546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.846825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.846907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.847102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.847185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.847450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.853803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.854170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.854253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.854571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.859824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.860121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.860242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.860407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.860564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.860722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.860855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.861040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.861172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.861323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.861468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.861603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.861751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.861878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.862036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.862321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.877923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.878200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.878531 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.878814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.882061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.882709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.885277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.885572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.885982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.886284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.889785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.890544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.893490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.894272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.896685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.897003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.897288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.897533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.897617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.897838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.897920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.898131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.898216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.898436 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.898741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.899023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.913882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.914170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.914436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.914699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.914925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.915216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.915488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.915756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.921532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.922655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.923111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.924232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.924637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.924922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.925796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.926085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.927675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.927958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.928240 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.928523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.928786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.928907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.929120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.929392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.929677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.930064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.940522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.940804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.941110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.941391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.941779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.941917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.942069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.942206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.942347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.942492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.942779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.943175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.943463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.943747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.957729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.959303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.960602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.962249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.963511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.964939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.965191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.966424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.966627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.966711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.967098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.968223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.968510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.968908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.973997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.975408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.975812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.977589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.978538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.978937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.979220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.979496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.980477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.980878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.981189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.981478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.987327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.987618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.987898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.989410 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.989704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.989989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.994784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.995070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.995348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.995621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.995891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.996162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.996434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.996714 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.996936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 01:57:41.997041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.997250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.997332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.997531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.997622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.997800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.997891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.998064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.998154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.998322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.998404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.998605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.998897 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.999183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.999458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:41.999742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:42.000019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:42.000291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:42.000557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 01:57:42.032992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bcac4199c0 pid: 81612 (default app) Oct 23 01:57:42.035725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bcac4199c0 pid: 81613 (default app) Oct 23 01:57:42.036233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5947ef-5eae-420a-b952-394600a009d9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:42.036519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5947ef-5eae-420a-b952-394600a009d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:42.036794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5947ef-5eae-420a-b952-394600a009d9 None None] PATH_INFO: `/v3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:42.040948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Sun Oct 23 01:57:42 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:57:48.726271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe885-4b79-400d-b362-b471632be651 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:48.726780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe885-4b79-400d-b362-b471632be651 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:48.726883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe885-4b79-400d-b362-b471632be651 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:48.731127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:48.736180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:48.736750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:48.736750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:48.806943 dv-cinder-861491-5-smb devstack@keystone.service[81612]: INFO dbcounter [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] Registered counter for database keystone Oct 23 01:57:48.826020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG oslo_db.sqlalchemy.engines [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:57:48.832761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writer thread running {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:57:49.009784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81612) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 01:57:49.010091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81612) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 01:57:49.067416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:49.069057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:49.194977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 01:57:49.653345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe885-4b79-400d-b362-b471632be651 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:49.722550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: INFO dbcounter [None req-888fe885-4b79-400d-b362-b471632be651 None None] Registered counter for database keystone Oct 23 01:57:49.744601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG oslo_db.sqlalchemy.engines [None req-888fe885-4b79-400d-b362-b471632be651 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 01:57:49.750717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writer thread running {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 01:57:49.869117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe885-4b79-400d-b362-b471632be651 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:49.873330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fa573-2feb-4f1f-b60e-cea8f06bba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:49.873969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa573-2feb-4f1f-b60e-cea8f06bba35 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:49.874250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa573-2feb-4f1f-b60e-cea8f06bba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:49.874522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa573-2feb-4f1f-b60e-cea8f06bba35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:49.883446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fa573-2feb-4f1f-b60e-cea8f06bba35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:49.934775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf0fa573-2feb-4f1f-b60e-cea8f06bba35 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 01:57:49.935125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fa573-2feb-4f1f-b60e-cea8f06bba35 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:49.944918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Sun Oct 23 01:57:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:57:49.951088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:49.967574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd1f79-c275-46ba-941e-9e694a455d84 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:49.972484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f794c-3942-4248-88bd-94ad172288b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:49.973618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f794c-3942-4248-88bd-94ad172288b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:49.973901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f794c-3942-4248-88bd-94ad172288b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:49.974174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f794c-3942-4248-88bd-94ad172288b6 admin admin] PATH_INFO: `/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:49.976005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f794c-3942-4248-88bd-94ad172288b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=6f5af6c6d2bb4361a1d4b7374821b416)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:50.028572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING keystone.common.rbac_enforcer.enforcer [None req-717f794c-3942-4248-88bd-94ad172288b6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 01:57:50.028915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f794c-3942-4248-88bd-94ad172288b6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:50.033903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Sun Oct 23 01:57:49 2022] GET /identity/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:57:52.136670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661e6c-0ae6-4f3c-8458-30de76731917 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:52.137119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661e6c-0ae6-4f3c-8458-30de76731917 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:52.137228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661e6c-0ae6-4f3c-8458-30de76731917 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:52.141350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:52.146808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749df0e-91fd-4598-9f35-6f8c8fdf1721 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:52.147192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749df0e-91fd-4598-9f35-6f8c8fdf1721 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:52.147364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749df0e-91fd-4598-9f35-6f8c8fdf1721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:52.167014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f749df0e-91fd-4598-9f35-6f8c8fdf1721 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:52.168521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f749df0e-91fd-4598-9f35-6f8c8fdf1721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:52.176858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 01:57:52.444491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661e6c-0ae6-4f3c-8458-30de76731917 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:52.456983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661e6c-0ae6-4f3c-8458-30de76731917 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:52.461097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c0f39-8b44-4146-93e6-629825af2323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:52.461691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0f39-8b44-4146-93e6-629825af2323 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:52.461966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0f39-8b44-4146-93e6-629825af2323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:52.462234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0f39-8b44-4146-93e6-629825af2323 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:52.469774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c0f39-8b44-4146-93e6-629825af2323 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:52.471541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c0f39-8b44-4146-93e6-629825af2323 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:52.480380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Sun Oct 23 01:57:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:57:52.485640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749df0e-91fd-4598-9f35-6f8c8fdf1721 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:52.494613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749df0e-91fd-4598-9f35-6f8c8fdf1721 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:52.498911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7610d4-daa0-4181-922e-8245d85d71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:52.499536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7610d4-daa0-4181-922e-8245d85d71c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:52.499818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7610d4-daa0-4181-922e-8245d85d71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:52.500093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7610d4-daa0-4181-922e-8245d85d71c3 admin admin] PATH_INFO: `/v3/users/f9e56f541ea740a1989e45c1dc0e8565` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:52.501949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7610d4-daa0-4181-922e-8245d85d71c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9e56f541ea740a1989e45c1dc0e8565)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:52.503768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7610d4-daa0-4181-922e-8245d85d71c3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:52.505304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Sun Oct 23 01:57:52 2022] GET /identity/v3/users/f9e56f541ea740a1989e45c1dc0e8565 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:57:54.676957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ca1f-0928-43ee-9738-6a1be47220e9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:54.677551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ca1f-0928-43ee-9738-6a1be47220e9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:54.677551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ca1f-0928-43ee-9738-6a1be47220e9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:54.678856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:54.684186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d657-a475-424a-bd04-24a97ae70342 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:54.684605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d657-a475-424a-bd04-24a97ae70342 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:54.684739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d657-a475-424a-bd04-24a97ae70342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:54.703096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7b82d657-a475-424a-bd04-24a97ae70342 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:54.704940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7b82d657-a475-424a-bd04-24a97ae70342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:54.727567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267af5-10e1-4778-b0ba-45c2bba1690d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:54.727843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267af5-10e1-4778-b0ba-45c2bba1690d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:54.728110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267af5-10e1-4778-b0ba-45c2bba1690d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:54.729455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:57:54.734660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:54.735037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:54.735369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:54.777429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG passlib.handlers.bcrypt [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81613) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 01:57:54.777833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG passlib.handlers.bcrypt [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81613) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 01:57:54.787160 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:57:54.826657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:54.828223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:54.926873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:57:55.054334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d657-a475-424a-bd04-24a97ae70342 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.077456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:55.161150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d657-a475-424a-bd04-24a97ae70342 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.193866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.194497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.194775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.195048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.198223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.208630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:57:55.217498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:57:55.218567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:57:55.220015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:57:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:57:55.226741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.297862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4424edd-9761-4b3a-a67b-a90436044770 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.300154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:55.306277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:55.325274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f5d8-88ce-47b0-8066-addf64b25502 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.335427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.336297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.336572 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.336842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.337830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:55.339253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:55.350315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.sql.core [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 01:57:55.350315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:57:55.350315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [parameters: {'id': '35df9e5ceeaf43319fbe42335b6513e8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 01:57:55.350315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 01:57:55.362431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.363406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.363784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.364274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.365506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:57:55.366057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:55.367973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:57:55.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 01:57:55.369933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application yield resource Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise self.value Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application session.commit() Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:57:55.370895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:57:55.371727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:57:55.372607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:57:55.373426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [parameters: {'id': '35df9e5ceeaf43319fbe42335b6513e8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 01:57:55.374239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:57:55.374959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 8/15] 10.222.0.25 () {60 vars in 1137 bytes} [Sun Oct 23 01:57:55 2022] POST /identity/v3/domains => generated 190 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:57:55.377085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.386056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 8/16] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:57:55.392092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.476686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67d8a-37d0-4d5a-8935-40ad0441e967 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.487633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b54999-8dcc-4727-bf49-d9971481a096 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.510102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.510957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.511236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.511511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.520951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.521610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.521888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.522156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] PATH_INFO: `/v3/users/f9e56f541ea740a1989e45c1dc0e8565` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.523298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] RBAC: Authorizing `identity:get_user(user_id=f9e56f541ea740a1989e45c1dc0e8565)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:55.524757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:55.526363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:57:55 2022] GET /identity/v3/users/f9e56f541ea740a1989e45c1dc0e8565 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:57:55.530017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:55.531566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:55.531760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.545994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:57:55.547810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:57:55.548702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:57:55.549552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:57:55.549552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:57:55.549552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:55.549552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:57:55.554669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.576541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:55.634904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efcf2-062a-4f74-94d9-0b5e2cfb48a5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.654415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59b5c-5ed1-46d2-a53f-97130c807dd6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.670557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.671193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.671471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.671738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.672883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:55.674354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:55.675895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:57:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:57:55.681584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:55.690688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ad93-884f-4e60-b06e-24b8dec6bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.691301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ad93-884f-4e60-b06e-24b8dec6bba3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.691583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ad93-884f-4e60-b06e-24b8dec6bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.691856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ad93-884f-4e60-b06e-24b8dec6bba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.692497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ad93-884f-4e60-b06e-24b8dec6bba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:57:55.692803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ad93-884f-4e60-b06e-24b8dec6bba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:55.694221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ad93-884f-4e60-b06e-24b8dec6bba3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:55.712509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:57:55.763630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:55.784858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040b1c-e801-4877-afe2-fc73ca27fa5f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:55.819501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb170-1f73-418e-9d58-241c4382fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:55.820180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb170-1f73-418e-9d58-241c4382fe2a None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:55.820456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb170-1f73-418e-9d58-241c4382fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:55.820727 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb170-1f73-418e-9d58-241c4382fe2a None admin] PATH_INFO: `/v3/domains/default/users/f9e56f541ea740a1989e45c1dc0e8565/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:55.822722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb170-1f73-418e-9d58-241c4382fe2a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f9e56f541ea740a1989e45c1dc0e8565, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:55.824187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb170-1f73-418e-9d58-241c4382fe2a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:55.939560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1361 bytes} [Sun Oct 23 01:57:55 2022] PUT /identity/v3/domains/default/users/f9e56f541ea740a1989e45c1dc0e8565/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:57:58.245861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bd997-334d-402d-b699-f522c93ab533 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:58.246888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bd997-334d-402d-b699-f522c93ab533 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:58.247373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bd997-334d-402d-b699-f522c93ab533 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:58.248892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:58.255369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3af7e-d59b-4621-948c-12cbfb04ea76 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:58.255775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3af7e-d59b-4621-948c-12cbfb04ea76 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:58.255943 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3af7e-d59b-4621-948c-12cbfb04ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:58.282755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8bb3af7e-d59b-4621-948c-12cbfb04ea76 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:58.284350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8bb3af7e-d59b-4621-948c-12cbfb04ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:58.367298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:57:58.549034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb44b-c6f0-45b5-b2ed-4fdcc5c1fe09 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:58.549673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb44b-c6f0-45b5-b2ed-4fdcc5c1fe09 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:58.550157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb44b-c6f0-45b5-b2ed-4fdcc5c1fe09 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:58.551687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:58.557124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1fc6-ab5a-4e53-9b83-0bf639182abb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:58.557415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1fc6-ab5a-4e53-9b83-0bf639182abb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:58.557811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1fc6-ab5a-4e53-9b83-0bf639182abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:58.581961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2ccd1fc6-ab5a-4e53-9b83-0bf639182abb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:58.583159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2ccd1fc6-ab5a-4e53-9b83-0bf639182abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:58.661235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:58.665949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:57:58.929010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfb44b-c6f0-45b5-b2ed-4fdcc5c1fe09 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.039785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32e83-7e20-4b5f-abd8-957f01dc6e19 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.040138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32e83-7e20-4b5f-abd8-957f01dc6e19 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.040343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32e83-7e20-4b5f-abd8-957f01dc6e19 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.041037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:59.044740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:59.059538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03ced-729e-41b8-955e-325ddeee9b1c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.060120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03ced-729e-41b8-955e-325ddeee9b1c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.060616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03ced-729e-41b8-955e-325ddeee9b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.072925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfb44b-c6f0-45b5-b2ed-4fdcc5c1fe09 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:59.093242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e4b03ced-729e-41b8-955e-325ddeee9b1c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:59.094974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e4b03ced-729e-41b8-955e-325ddeee9b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:59.123151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eca1fb-e772-417b-9391-1c69168c436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:59.123794 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca1fb-e772-417b-9391-1c69168c436f None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.124067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca1fb-e772-417b-9391-1c69168c436f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.124341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca1fb-e772-417b-9391-1c69168c436f None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.125056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eca1fb-e772-417b-9391-1c69168c436f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:59.128638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eca1fb-e772-417b-9391-1c69168c436f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:59.194355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:57:59.195767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bfd1f-181c-4d72-9549-2cd350a36b3d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.196109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bfd1f-181c-4d72-9549-2cd350a36b3d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.196395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bfd1f-181c-4d72-9549-2cd350a36b3d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.197814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 16/28] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:59.198443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bfd1f-181c-4d72-9549-2cd350a36b3d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.271467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 13/29] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Oct 23 01:57:58 2022] POST /identity/v3/roles => generated 219 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:57:59.272879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19724964-109c-422d-b2a4-b01b6a624edb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.273182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19724964-109c-422d-b2a4-b01b6a624edb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.273612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19724964-109c-422d-b2a4-b01b6a624edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.300669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-19724964-109c-422d-b2a4-b01b6a624edb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:59.302643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-19724964-109c-422d-b2a4-b01b6a624edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:59.312283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bfd1f-181c-4d72-9549-2cd350a36b3d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:59.348215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:59.369152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:59.369861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.370153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.370435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.396930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:59.398629 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:57:59.427660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:57:59.428588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:57:59.429510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:57:59.429510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:57:59.429510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:57:59.429510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 17/30] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:57:59.440794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.447869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 14/31] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:57:59.579397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5677a8-071d-40bc-aac7-20c9db69b7d9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:59.606337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19724964-109c-422d-b2a4-b01b6a624edb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.651609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9365f-9f82-4b72-b6fc-64f4a4cf3c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:59.652243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9365f-9f82-4b72-b6fc-64f4a4cf3c37 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.652528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9365f-9f82-4b72-b6fc-64f4a4cf3c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.652808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9365f-9f82-4b72-b6fc-64f4a4cf3c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.653507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9365f-9f82-4b72-b6fc-64f4a4cf3c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:57:59.653817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9365f-9f82-4b72-b6fc-64f4a4cf3c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:59.657079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9365f-9f82-4b72-b6fc-64f4a4cf3c37 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:59.693145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 18/32] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:57:59.694452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a35fb-e595-4e27-9af7-576dc38fdcd6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.694747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a35fb-e595-4e27-9af7-576dc38fdcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.695030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a35fb-e595-4e27-9af7-576dc38fdcd6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.696359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 19/33] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:57:59.699376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a35fb-e595-4e27-9af7-576dc38fdcd6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.735712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:59.764198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:59.775361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19724964-109c-422d-b2a4-b01b6a624edb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:59.822919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e594a-3de2-4846-92b9-44c6825ad651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:59.823560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e594a-3de2-4846-92b9-44c6825ad651 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.823844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e594a-3de2-4846-92b9-44c6825ad651 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.824120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e594a-3de2-4846-92b9-44c6825ad651 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.838754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e594a-3de2-4846-92b9-44c6825ad651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:57:59.841643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a35fb-e595-4e27-9af7-576dc38fdcd6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-682e594a-3de2-4846-92b9-44c6825ad651 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:57:59.846668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:57:59.847561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 15/34] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:57:59.853268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024e8b8-1b69-44ff-9111-8c405177f6c4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.854163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024e8b8-1b69-44ff-9111-8c405177f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.854163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024e8b8-1b69-44ff-9111-8c405177f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.872291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e024e8b8-1b69-44ff-9111-8c405177f6c4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:59.873525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e024e8b8-1b69-44ff-9111-8c405177f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:59.884542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:59.885200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.885485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.885754 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.886426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:59.887906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:59.917898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 20/35] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:57:59 2022] POST /identity/v3/projects => generated 301 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:57:59.923201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.953506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 16/36] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:57:59.954340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024e8b8-1b69-44ff-9111-8c405177f6c4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.027172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:00.072486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:00.080073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024e8b8-1b69-44ff-9111-8c405177f6c4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.085941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aac01-29fb-4325-9533-833355d44cce None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.126951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bc391-9cd5-4e18-af43-7bba197ff28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.127880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc391-9cd5-4e18-af43-7bba197ff28c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.128364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc391-9cd5-4e18-af43-7bba197ff28c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.128790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc391-9cd5-4e18-af43-7bba197ff28c None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.130396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc391-9cd5-4e18-af43-7bba197ff28c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:00.130707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc391-9cd5-4e18-af43-7bba197ff28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.132805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc391-9cd5-4e18-af43-7bba197ff28c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.144961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543db082-21f1-4d88-bd6b-1017ca4c18db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.145639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db082-21f1-4d88-bd6b-1017ca4c18db None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.145924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db082-21f1-4d88-bd6b-1017ca4c18db None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.146202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db082-21f1-4d88-bd6b-1017ca4c18db None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.146909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543db082-21f1-4d88-bd6b-1017ca4c18db None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.148360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543db082-21f1-4d88-bd6b-1017ca4c18db None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.150248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 17/37] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:00.151733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c236c7-869f-4539-bb8a-9e2c6e3b0a68 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.152365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c236c7-869f-4539-bb8a-9e2c6e3b0a68 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.152649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c236c7-869f-4539-bb8a-9e2c6e3b0a68 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.154487 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 18/38] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:00.159454 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c236c7-869f-4539-bb8a-9e2c6e3b0a68 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.181133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 21/39] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Oct 23 01:57:59 2022] POST /identity/v3/roles => generated 225 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:00.181133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4a6fe-1b39-4e48-a4c2-57f5ac0f1696 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.181133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4a6fe-1b39-4e48-a4c2-57f5ac0f1696 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.181133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4a6fe-1b39-4e48-a4c2-57f5ac0f1696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.206614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fee4a6fe-1b39-4e48-a4c2-57f5ac0f1696 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:00.207822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fee4a6fe-1b39-4e48-a4c2-57f5ac0f1696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:00.321148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c236c7-869f-4539-bb8a-9e2c6e3b0a68 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.356737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:00.372870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.373581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.373866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.374142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] PATH_INFO: `/v3/users/f9e56f541ea740a1989e45c1dc0e8565` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.375681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] RBAC: Authorizing `identity:get_user(user_id=f9e56f541ea740a1989e45c1dc0e8565)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.377255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.379012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 19/40] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:00 2022] GET /identity/v3/users/f9e56f541ea740a1989e45c1dc0e8565 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:00.379836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.433288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 22/41] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:00.433288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4a6fe-1b39-4e48-a4c2-57f5ac0f1696 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.501192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c02a2-34c9-4b7d-8c4a-6098c8131a1c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.527872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:00.538712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.539328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.539607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.539877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.540534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.541956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.547744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4a6fe-1b39-4e48-a4c2-57f5ac0f1696 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.561031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 20/42] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Oct 23 01:58:00 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:00.585402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.586070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.586353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.586621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.587806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.589382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.591217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 23/43] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:00.597553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.652864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:00.703098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.710659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec35ea-196a-49d1-b238-6d4092675afa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.749377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.750006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.750287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.750668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.752083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.domain.id=default, user.id=f9e56f541ea740a1989e45c1dc0e8565) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:00.752083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.753567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.764546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 21/44] 10.222.0.25 () {56 vars in 1322 bytes} [Sun Oct 23 01:58:00 2022] GET /identity/v3/role_assignments?user.id=f9e56f541ea740a1989e45c1dc0e8565&scope.domain.id=default&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 530 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:00.830278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551220d8-441c-4ae1-819e-16902bfa7265 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.866633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f7136-7bb2-4ed9-b8a6-01b761badf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.867284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f7136-7bb2-4ed9-b8a6-01b761badf7e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.867573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f7136-7bb2-4ed9-b8a6-01b761badf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.867839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f7136-7bb2-4ed9-b8a6-01b761badf7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.868962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f7136-7bb2-4ed9-b8a6-01b761badf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.870453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f7136-7bb2-4ed9-b8a6-01b761badf7e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.872051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 24/45] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:00.877966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.982060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962ede-5686-4c48-b89c-f9d35ce53b9b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.996147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:01.015878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17d755-5e53-491c-8c00-2313687bfb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.016956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17d755-5e53-491c-8c00-2313687bfb3c None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.017263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17d755-5e53-491c-8c00-2313687bfb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.017543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17d755-5e53-491c-8c00-2313687bfb3c None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.018184 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17d755-5e53-491c-8c00-2313687bfb3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:01.019618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17d755-5e53-491c-8c00-2313687bfb3c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.045375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 22/46] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:58:00 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:03.186140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ecd35-1120-47e3-b68e-2517b409631b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:03.186587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ecd35-1120-47e3-b68e-2517b409631b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:03.186692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ecd35-1120-47e3-b68e-2517b409631b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:03.188059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 25/47] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:03.193687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ae04-c2d5-48d3-9c3c-0fcee43a38af None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:03.194088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ae04-c2d5-48d3-9c3c-0fcee43a38af None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:03.194246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ae04-c2d5-48d3-9c3c-0fcee43a38af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:03.212113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-24f2ae04-c2d5-48d3-9c3c-0fcee43a38af None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:03.213338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-24f2ae04-c2d5-48d3-9c3c-0fcee43a38af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:03.278139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:03.548603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ecd35-1120-47e3-b68e-2517b409631b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:03.570110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:03.646861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ecd35-1120-47e3-b68e-2517b409631b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:03.678816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b40a-4b25-4284-9387-4a716932769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:03.679443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b40a-4b25-4284-9387-4a716932769a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:03.679725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b40a-4b25-4284-9387-4a716932769a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:03.680001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b40a-4b25-4284-9387-4a716932769a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:03.681137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b40a-4b25-4284-9387-4a716932769a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:03.682572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b40a-4b25-4284-9387-4a716932769a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:03.684115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 26/49] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:03.690521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ae04-c2d5-48d3-9c3c-0fcee43a38af None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:03.781278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:03.787952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ae04-c2d5-48d3-9c3c-0fcee43a38af None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:03.821108 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a0b24-b8ad-49dc-803f-e80b6f03a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:03.821649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a0b24-b8ad-49dc-803f-e80b6f03a081 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:03.821927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a0b24-b8ad-49dc-803f-e80b6f03a081 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:03.822199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a0b24-b8ad-49dc-803f-e80b6f03a081 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:03.822835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a0b24-b8ad-49dc-803f-e80b6f03a081 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:03.824272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a0b24-b8ad-49dc-803f-e80b6f03a081 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:03.848949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 24/50] 10.222.0.25 () {60 vars in 1140 bytes} [Sun Oct 23 01:58:03 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:05.990678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d879bf6-fff7-452b-a4a3-24ceb97622b6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:05.991220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d879bf6-fff7-452b-a4a3-24ceb97622b6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:05.991220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d879bf6-fff7-452b-a4a3-24ceb97622b6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:05.992565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 27/51] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:05.997650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fc3f-a09f-4181-8727-93d8ffbec488 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:05.998017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fc3f-a09f-4181-8727-93d8ffbec488 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:05.998199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fc3f-a09f-4181-8727-93d8ffbec488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:06.017097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4526fc3f-a09f-4181-8727-93d8ffbec488 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:06.018275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4526fc3f-a09f-4181-8727-93d8ffbec488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:06.083032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 25/52] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:06.352592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d879bf6-fff7-452b-a4a3-24ceb97622b6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:06.439172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:06.452153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d879bf6-fff7-452b-a4a3-24ceb97622b6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:06.485026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d91f-f586-4c1e-94f3-42c9213f2f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:06.485654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d91f-f586-4c1e-94f3-42c9213f2f08 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:06.485941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d91f-f586-4c1e-94f3-42c9213f2f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:06.486217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d91f-f586-4c1e-94f3-42c9213f2f08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:06.487340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d91f-f586-4c1e-94f3-42c9213f2f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:06.488784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d91f-f586-4c1e-94f3-42c9213f2f08 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:06.490372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 28/53] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:06.495717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526fc3f-a09f-4181-8727-93d8ffbec488 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:06.570113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:06.592187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526fc3f-a09f-4181-8727-93d8ffbec488 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:06.624387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72a56e-b7f7-48b5-bd00-86efdbf5e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:06.624935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72a56e-b7f7-48b5-bd00-86efdbf5e11a None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:06.625764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72a56e-b7f7-48b5-bd00-86efdbf5e11a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:06.626040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72a56e-b7f7-48b5-bd00-86efdbf5e11a None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:06.626678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72a56e-b7f7-48b5-bd00-86efdbf5e11a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:06.628121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72a56e-b7f7-48b5-bd00-86efdbf5e11a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:06.654318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 26/54] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:06 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:09.922411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e93dc-5c45-45c6-b56d-1a04264b0d5c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:09.922947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e93dc-5c45-45c6-b56d-1a04264b0d5c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:09.922947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e93dc-5c45-45c6-b56d-1a04264b0d5c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:09.924550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 29/55] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:09.929897 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38634-3c6d-4bd1-83fd-4997a3960edc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:09.930760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38634-3c6d-4bd1-83fd-4997a3960edc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:09.931230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38634-3c6d-4bd1-83fd-4997a3960edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:09.958014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-27c38634-3c6d-4bd1-83fd-4997a3960edc None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:09.959862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-27c38634-3c6d-4bd1-83fd-4997a3960edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:10.036424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c77b-c20c-4ed1-908d-d6bfd3bc3bd0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.037100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c77b-c20c-4ed1-908d-d6bfd3bc3bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.037571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c77b-c20c-4ed1-908d-d6bfd3bc3bd0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.039180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 30/56] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:58:10.045255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d75a-6cfc-437f-b436-6e72db97f218 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.045875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d75a-6cfc-437f-b436-6e72db97f218 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.046343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d75a-6cfc-437f-b436-6e72db97f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.083051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7c02d75a-6cfc-437f-b436-6e72db97f218 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:10.084615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c02d75a-6cfc-437f-b436-6e72db97f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:10.201854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 31/57] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:10.203590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec132-b6cc-4f13-926e-5d53c9a88e0c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.204098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec132-b6cc-4f13-926e-5d53c9a88e0c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.204585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec132-b6cc-4f13-926e-5d53c9a88e0c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.206047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 32/58] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:10.216998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614c69e-a22a-40e1-bd2a-a03c535dabe9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.216998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614c69e-a22a-40e1-bd2a-a03c535dabe9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.216998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614c69e-a22a-40e1-bd2a-a03c535dabe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.233614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3614c69e-a22a-40e1-bd2a-a03c535dabe9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:10.234972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3614c69e-a22a-40e1-bd2a-a03c535dabe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:10.235292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 27/59] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:10.275893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d268c-497d-4f43-baf8-b6d9b9e5c684 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.276223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d268c-497d-4f43-baf8-b6d9b9e5c684 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.276462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d268c-497d-4f43-baf8-b6d9b9e5c684 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.277834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 28/60] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:58:10.290361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f32c5-c450-407d-9eaf-ba2fc0ecad23 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.290651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f32c5-c450-407d-9eaf-ba2fc0ecad23 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.290932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f32c5-c450-407d-9eaf-ba2fc0ecad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.327346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-603f32c5-c450-407d-9eaf-ba2fc0ecad23 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:10.328630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-603f32c5-c450-407d-9eaf-ba2fc0ecad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:10.335552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 33/61] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:10.416715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:10.426649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 29/62] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:10.495569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614c69e-a22a-40e1-bd2a-a03c535dabe9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:10.514243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:10.613606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f32c5-c450-407d-9eaf-ba2fc0ecad23 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:10.623403 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614c69e-a22a-40e1-bd2a-a03c535dabe9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:10.678646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:10.679636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.680139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.680597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.695467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:10.703206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:10.704073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:10.704824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:10.706419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 34/63] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:58:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:10.711418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:10.761558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f32c5-c450-407d-9eaf-ba2fc0ecad23 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:10.797776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:10.798416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.798700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.798973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.809567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:10.815104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:10.815955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:10.816785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 30/64] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:10.818374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:10.821443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:10.847003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2a071-32fc-437e-96dc-8917ea03221c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:10.873323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:10.881636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:10.882274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.882558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.882836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.893360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:10.898292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:10.899152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:10.899901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 35/65] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:58:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:10.900520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:10.917957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9494965-3c58-454e-a91f-6a586b6a3704 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:10.951656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:10.952242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:10.952529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:10.952801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:10.953508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:10.953810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:10.955168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:10.963080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 31/66] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:10.963867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.007076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc307e42-4580-48e0-909c-b42748402321 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.040541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0eea9-1933-47cc-81c6-31e79d3da4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.041143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0eea9-1933-47cc-81c6-31e79d3da4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.041430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0eea9-1933-47cc-81c6-31e79d3da4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.041709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0eea9-1933-47cc-81c6-31e79d3da4d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.044287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.052802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0eea9-1933-47cc-81c6-31e79d3da4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-37a0eea9-1933-47cc-81c6-31e79d3da4d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:11.057744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:11.058601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:11.059355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 36/67] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:11.060149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565c38-98d1-4d0d-982e-c19db812d46d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.060420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565c38-98d1-4d0d-982e-c19db812d46d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.060694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565c38-98d1-4d0d-982e-c19db812d46d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.062973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 37/68] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:11.063691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565c38-98d1-4d0d-982e-c19db812d46d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.067904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdbaf8-18fb-4558-9c08-09b629252be6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.084362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.102385 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.102994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.103273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.103541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.104195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:11.104495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.105976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.121405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 32/69] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.121405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.167682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565c38-98d1-4d0d-982e-c19db812d46d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.201931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.202535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.202818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.203121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.203799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:11.204109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.205570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.213721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 38/70] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.214520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.215431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993575-9d24-446e-bcd0-ab0d8c9dc979 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.254069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac7a5e-e3f4-40bd-95b0-de7c89db7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.254701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac7a5e-e3f4-40bd-95b0-de7c89db7b71 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.254984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac7a5e-e3f4-40bd-95b0-de7c89db7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.255261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac7a5e-e3f4-40bd-95b0-de7c89db7b71 None admin] PATH_INFO: `/v3/users/f9e56f541ea740a1989e45c1dc0e8565` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.256397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac7a5e-e3f4-40bd-95b0-de7c89db7b71 None admin] RBAC: Authorizing `identity:get_user(user_id=f9e56f541ea740a1989e45c1dc0e8565)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.257878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac7a5e-e3f4-40bd-95b0-de7c89db7b71 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.263800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 33/71] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/users/f9e56f541ea740a1989e45c1dc0e8565 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.263800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7b51-0b35-4b1e-ab25-b1bb338141a6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.263800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7b51-0b35-4b1e-ab25-b1bb338141a6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.263800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7b51-0b35-4b1e-ab25-b1bb338141a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.272617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.279320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b87c7b51-0b35-4b1e-ab25-b1bb338141a6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:11.280533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b87c7b51-0b35-4b1e-ab25-b1bb338141a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:11.314022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41833e1a-1872-4146-b605-58e63fa281f3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.321696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.345758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 34/72] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:11.346567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c7b51-0b35-4b1e-ab25-b1bb338141a6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.357869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.358516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.358796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.359066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.360241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:11.360543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.361954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.370218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 39/73] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.376182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.449379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c7b51-0b35-4b1e-ab25-b1bb338141a6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.477701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83184-098c-4ef3-959b-e893008edcbf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.485564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.486198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.486473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.486745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] PATH_INFO: `/v3/users/717327774a4146f69129e15672f31b53` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.500779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.503575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] RBAC: Authorizing `identity:get_user(user_id=717327774a4146f69129e15672f31b53)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.505073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.507018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 35/74] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/users/717327774a4146f69129e15672f31b53 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.507590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.520243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.520882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.521349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.521461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] PATH_INFO: `/v3/users/717327774a4146f69129e15672f31b53` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.522597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] RBAC: Authorizing `identity:get_user(user_id=717327774a4146f69129e15672f31b53)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.524076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.525725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 40/75] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/users/717327774a4146f69129e15672f31b53 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.526419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.547513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.624102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c22766-610c-41c9-9b5c-d06023eac71b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.631217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff68416-412f-4c2c-8d9b-25b6d9cb02d4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.658111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.658743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.659026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.659309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.660567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.662057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.663685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 36/76] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.663946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.664581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.664689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.665039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.665374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] PATH_INFO: `/v3/users/717327774a4146f69129e15672f31b53` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.666568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] RBAC: Authorizing `identity:get_user(user_id=717327774a4146f69129e15672f31b53)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.668052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.674497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 41/77] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/users/717327774a4146f69129e15672f31b53 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.674497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.728679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.765025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d8348-c6e1-43d3-9acc-23c705124937 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.766569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.771293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e94f-d4ca-49b6-ba93-6b2257e032b3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.800712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.801379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.801663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.801939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.803065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.804520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.804795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.805466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.805753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.806029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.806187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 37/78] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.806949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.807167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.808680 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.810359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 42/79] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.811315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.907569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7b34-ac85-40e7-922c-c5f42451a618 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.908821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b71f82-4645-4108-987d-cfa5a8d4239c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:11.932387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:11.942742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.943365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.943640 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.943908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.944349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:11.945038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:11.945127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.945325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:11.945602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/f9e56f541ea740a1989e45c1dc0e8565/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:11.946508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.947519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] RBAC: Authorizing `identity:create_grant(project_id=7084cc89abc448658c55aaca1e3c30e4, user_id=f9e56f541ea740a1989e45c1dc0e8565, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:11.948057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 38/80] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:11.948813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.949000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:11.963639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 43/81] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:11 2022] PUT /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/f9e56f541ea740a1989e45c1dc0e8565/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:11.964320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:11.992384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:12.064242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e251bfd-fb3a-4d99-80dd-e68cfce156e8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:12.092070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66fe76-7ad4-4a32-82e2-0c2ecb4b7daa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:12.110011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:12.110675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:12.110954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:12.111223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] PATH_INFO: `/v3/projects/41f44e6e873d4d1b9bafea1aa089b5c4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:12.112400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] RBAC: Authorizing `identity:get_project(project_id=41f44e6e873d4d1b9bafea1aa089b5c4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:12.115886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:12.115886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 39/82] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:11 2022] GET /identity/v3/projects/41f44e6e873d4d1b9bafea1aa089b5c4 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:12.116363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:12.144621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:12.145841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:12.146130 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:12.146408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/717327774a4146f69129e15672f31b53/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:12.148362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=7084cc89abc448658c55aaca1e3c30e4, user_id=717327774a4146f69129e15672f31b53, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:12.149859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:12.164051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 44/83] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:11 2022] PUT /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/717327774a4146f69129e15672f31b53/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:12.165146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:12.229973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:12.269129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838085-0a61-42d1-a4fd-a8c42917b699 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:12.280059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:12.312140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:12.312942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:12.313278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:12.313559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/717327774a4146f69129e15672f31b53/roles/04c3574945c544d08b9e6b4c7ad69561` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:12.315910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] RBAC: Authorizing `identity:create_grant(project_id=7084cc89abc448658c55aaca1e3c30e4, user_id=717327774a4146f69129e15672f31b53, role_id=04c3574945c544d08b9e6b4c7ad69561)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:12.317523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:12.324922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00ef88-a1f2-4d49-8006-7573237d0c77 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:12.335569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 40/84] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:12 2022] PUT /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/717327774a4146f69129e15672f31b53/roles/04c3574945c544d08b9e6b4c7ad69561 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:12.336276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:12.376346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07aef9-f016-4d10-89bb-984655250c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:12.377101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07aef9-f016-4d10-89bb-984655250c33 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:12.377427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07aef9-f016-4d10-89bb-984655250c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:12.377806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07aef9-f016-4d10-89bb-984655250c33 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:12.378651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07aef9-f016-4d10-89bb-984655250c33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:12.380169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07aef9-f016-4d10-89bb-984655250c33 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:12.422418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 45/85] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:12 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:12.469589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89f30-7d0b-4420-8cdf-ac72673b1c6d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:12.513756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696458-6b32-4dff-84fa-b6f33870841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:12.514517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696458-6b32-4dff-84fa-b6f33870841d None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:12.514802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696458-6b32-4dff-84fa-b6f33870841d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:12.515077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696458-6b32-4dff-84fa-b6f33870841d None admin] PATH_INFO: `/v3/projects/41f44e6e873d4d1b9bafea1aa089b5c4/users/717327774a4146f69129e15672f31b53/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:12.517336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696458-6b32-4dff-84fa-b6f33870841d None admin] RBAC: Authorizing `identity:create_grant(project_id=41f44e6e873d4d1b9bafea1aa089b5c4, user_id=717327774a4146f69129e15672f31b53, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:12.518819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696458-6b32-4dff-84fa-b6f33870841d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:12.536152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 41/86] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:12 2022] PUT /identity/v3/projects/41f44e6e873d4d1b9bafea1aa089b5c4/users/717327774a4146f69129e15672f31b53/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:14.397549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058c2e-a066-487a-a9ad-691afa9d4a24 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:14.398025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058c2e-a066-487a-a9ad-691afa9d4a24 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:14.398025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058c2e-a066-487a-a9ad-691afa9d4a24 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:14.399370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 46/87] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:14.404820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75d18a-bb1b-4e67-a8a5-cb5217e26144 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:14.405246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75d18a-bb1b-4e67-a8a5-cb5217e26144 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:14.405408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75d18a-bb1b-4e67-a8a5-cb5217e26144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:14.433992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eb75d18a-bb1b-4e67-a8a5-cb5217e26144 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:14.435194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb75d18a-bb1b-4e67-a8a5-cb5217e26144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:14.463552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:14.519036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 42/88] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:14.879786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830252b7-544b-49ff-b269-e3d5b7e89cc0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:14.880150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830252b7-544b-49ff-b269-e3d5b7e89cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:14.880348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830252b7-544b-49ff-b269-e3d5b7e89cc0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:14.881972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 47/89] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:14.887438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a7a82-f644-41c0-8407-f4dc9da51a63 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:14.887936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a7a82-f644-41c0-8407-f4dc9da51a63 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:14.888400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a7a82-f644-41c0-8407-f4dc9da51a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:14.913768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8b9a7a82-f644-41c0-8407-f4dc9da51a63 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:14.915345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8b9a7a82-f644-41c0-8407-f4dc9da51a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:14.990865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 43/90] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:15.068439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830252b7-544b-49ff-b269-e3d5b7e89cc0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:15.194424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:15.199013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830252b7-544b-49ff-b269-e3d5b7e89cc0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:15.227616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360f678-1217-4fd1-8a38-8f0f282b2292 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.227911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360f678-1217-4fd1-8a38-8f0f282b2292 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.228173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360f678-1217-4fd1-8a38-8f0f282b2292 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.229551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 44/91] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:15.234911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc96ce7-f450-4d0d-9106-d714580d3912 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.235195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc96ce7-f450-4d0d-9106-d714580d3912 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.235472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc96ce7-f450-4d0d-9106-d714580d3912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.266079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0dc96ce7-f450-4d0d-9106-d714580d3912 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:15.267256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0dc96ce7-f450-4d0d-9106-d714580d3912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:15.270319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:15.270962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.271238 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.271506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.305874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:15.310889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:15.311716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:15.313117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 48/92] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:15.318260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:15.416966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 45/93] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:15.418544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc96ce7-f450-4d0d-9106-d714580d3912 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:15.453142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:15.475259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99fd55-5227-4ab9-9482-d7ccfa8d3cd8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:15.527025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:15.527871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.529343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.529786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.530589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:15.532777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:15.535820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:15.559074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 49/94] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:15.564608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:15.635798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc96ce7-f450-4d0d-9106-d714580d3912 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:15.645359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:15.700473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:15.702622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.704256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.705188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.738871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:15.745598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:15.746553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:15.747311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:15.751294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d22b75-3b0e-452d-8d09-219dcdbac9e7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:15.758363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 46/95] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:15.766123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:15.830326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:15.831346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.831856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.832332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] PATH_INFO: `/v3/users/f9e56f541ea740a1989e45c1dc0e8565` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.837703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] RBAC: Authorizing `identity:get_user(user_id=f9e56f541ea740a1989e45c1dc0e8565)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:15.839484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:15.841390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 50/96] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/users/f9e56f541ea740a1989e45c1dc0e8565 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:15.846987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:15.895055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:15.921042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796c4a3-cbc2-4ebb-aeab-32f9c9f078de None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:15.962970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19073c4-78b7-4420-bfbe-9d2024c87e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:15.964101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19073c4-78b7-4420-bfbe-9d2024c87e91 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.964552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19073c4-78b7-4420-bfbe-9d2024c87e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.964992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19073c4-78b7-4420-bfbe-9d2024c87e91 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.965801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19073c4-78b7-4420-bfbe-9d2024c87e91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:15.966248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19073c4-78b7-4420-bfbe-9d2024c87e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:15.968233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19073c4-78b7-4420-bfbe-9d2024c87e91 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:15.970410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:15.979141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 47/97] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:15.980597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de383-6ea4-4d59-ba10-e5fca94d3dee None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.981100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de383-6ea4-4d59-ba10-e5fca94d3dee None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.981518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de383-6ea4-4d59-ba10-e5fca94d3dee None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.982855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 48/98] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:15.983027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6e70f-fc8a-43f2-b3e0-583ca3dd970f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:15.983850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811de383-6ea4-4d59-ba10-e5fca94d3dee None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.024827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.025646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.026031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.026409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.115390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811de383-6ea4-4d59-ba10-e5fca94d3dee None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:16.138976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:16.141008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:16.156678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4086fe-52b7-439e-80bf-dcaa32db3485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.157511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4086fe-52b7-439e-80bf-dcaa32db3485 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.158061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4086fe-52b7-439e-80bf-dcaa32db3485 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.158432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4086fe-52b7-439e-80bf-dcaa32db3485 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.166920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.172582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4086fe-52b7-439e-80bf-dcaa32db3485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3d4086fe-52b7-439e-80bf-dcaa32db3485 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:16.178823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:16.179760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:16.180561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:16.181182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 49/99] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:16.182226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19f99-967d-46a0-95ab-a60a7a7cee00 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.182522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19f99-967d-46a0-95ab-a60a7a7cee00 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.182774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19f99-967d-46a0-95ab-a60a7a7cee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.202525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-09f19f99-967d-46a0-95ab-a60a7a7cee00 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:16.204253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-09f19f99-967d-46a0-95ab-a60a7a7cee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:16.240852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.256891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 51/100] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 01:58:16.256891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.281349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:16.282027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19f99-967d-46a0-95ab-a60a7a7cee00 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.401809 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19f99-967d-46a0-95ab-a60a7a7cee00 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:16.407436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b322c-f706-4834-998e-6ee1c91a3d3b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:16.431280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.440851 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1e24c-5942-452c-b850-03c9cda85c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.441485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e24c-5942-452c-b850-03c9cda85c6b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.441825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e24c-5942-452c-b850-03c9cda85c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.442099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e24c-5942-452c-b850-03c9cda85c6b None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.442778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1e24c-5942-452c-b850-03c9cda85c6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:16.443083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1e24c-5942-452c-b850-03c9cda85c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:16.443175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bdc05-88a9-429c-aef6-735854bd6e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.443791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bdc05-88a9-429c-aef6-735854bd6e06 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.444073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bdc05-88a9-429c-aef6-735854bd6e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.444350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bdc05-88a9-429c-aef6-735854bd6e06 None admin] PATH_INFO: `/v3/users/717327774a4146f69129e15672f31b53` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.444499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1e24c-5942-452c-b850-03c9cda85c6b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:16.445499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bdc05-88a9-429c-aef6-735854bd6e06 None admin] RBAC: Authorizing `identity:get_user(user_id=717327774a4146f69129e15672f31b53)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:16.446931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bdc05-88a9-429c-aef6-735854bd6e06 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:16.448668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 52/102] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:16 2022] GET /identity/v3/users/717327774a4146f69129e15672f31b53 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:16.449686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764d8e-1e70-4261-ab41-cd94ee11d7ed None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.449973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764d8e-1e70-4261-ab41-cd94ee11d7ed None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.450248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764d8e-1e70-4261-ab41-cd94ee11d7ed None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.453085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 53/103] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:16.453085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764d8e-1e70-4261-ab41-cd94ee11d7ed None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.465028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 51/104] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:58:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:16.465028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100df45-1688-49d7-89c4-3560c881916e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.465028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100df45-1688-49d7-89c4-3560c881916e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.465028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100df45-1688-49d7-89c4-3560c881916e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.465028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 52/105] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:16.465028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100df45-1688-49d7-89c4-3560c881916e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.529672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.568566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100df45-1688-49d7-89c4-3560c881916e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:16.574243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764d8e-1e70-4261-ab41-cd94ee11d7ed None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:16.601914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c093-058c-4c8d-a1a6-ba67a2e3dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.602520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c093-058c-4c8d-a1a6-ba67a2e3dabf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.602802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c093-058c-4c8d-a1a6-ba67a2e3dabf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.603085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c093-058c-4c8d-a1a6-ba67a2e3dabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.607866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9fac0-5ced-42de-8d73-297a7960e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.608492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9fac0-5ced-42de-8d73-297a7960e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.608777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9fac0-5ced-42de-8d73-297a7960e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.609579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9fac0-5ced-42de-8d73-297a7960e7f0 None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.610716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9fac0-5ced-42de-8d73-297a7960e7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:16.612156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9fac0-5ced-42de-8d73-297a7960e7f0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:16.613811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 54/106] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:16 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:16.615052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985528a-bc55-4d88-9d54-f88780e2f7b3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.615337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985528a-bc55-4d88-9d54-f88780e2f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.615610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985528a-bc55-4d88-9d54-f88780e2f7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.633377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b985528a-bc55-4d88-9d54-f88780e2f7b3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:16.634547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b985528a-bc55-4d88-9d54-f88780e2f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:16.663530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.674518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0c093-058c-4c8d-a1a6-ba67a2e3dabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:16.675991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0c093-058c-4c8d-a1a6-ba67a2e3dabf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:16.699039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 55/107] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:16.699881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985528a-bc55-4d88-9d54-f88780e2f7b3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.755741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.801151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985528a-bc55-4d88-9d54-f88780e2f7b3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:16.805796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 53/108] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:16.807187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3acd-fc5b-4d41-ad0b-ffa9e37be959 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.807621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3acd-fc5b-4d41-ad0b-ffa9e37be959 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.808447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3acd-fc5b-4d41-ad0b-ffa9e37be959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.828310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-260c3acd-fc5b-4d41-ad0b-ffa9e37be959 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:16.829526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-260c3acd-fc5b-4d41-ad0b-ffa9e37be959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:16.835470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.836105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.836383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.836654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] PATH_INFO: `/v3/users/717327774a4146f69129e15672f31b53` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:16.837799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] RBAC: Authorizing `identity:get_user(user_id=717327774a4146f69129e15672f31b53)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:16.839255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:16.845195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 56/109] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:16 2022] GET /identity/v3/users/717327774a4146f69129e15672f31b53 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:16.845195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.904937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:16.906341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3acd-fc5b-4d41-ad0b-ffa9e37be959 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:16.938708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.957301 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b892-e3e4-4364-9403-c768ff3a3b5c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:16.984314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:16.996377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:16.997222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:16.997506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:16.997779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.008476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:17.013358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:17.014234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:17.015012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 57/111] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:17.015739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.032894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3acd-fc5b-4d41-ad0b-ffa9e37be959 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.069071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.069684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.069974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.070251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.071370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=7084cc89abc448658c55aaca1e3c30e4, user.id=f9e56f541ea740a1989e45c1dc0e8565) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:17.071474 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.072852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.079608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 55/112] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:16 2022] GET /identity/v3/role_assignments?user.id=f9e56f541ea740a1989e45c1dc0e8565&scope.project.id=7084cc89abc448658c55aaca1e3c30e4&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:17.080341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.141804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44522e-a35a-4136-8ee7-066ff7f4f5bb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.192026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.192687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.192968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.193269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.194435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.195925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.197639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 58/113] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:17.198732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.203529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.220757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0cb08-dd54-47de-ac78-e5ea6a927703 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.259970 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.265747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.266542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.266979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.267258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.318471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e615932-86aa-47c0-ad8c-b399ef0abaad None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.346485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.347893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.352460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.353118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.353399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.353669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.354763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.356188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.357774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 59/114] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:17.358613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.431806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.448856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 56/115] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:17.449708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.456035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27cd01-9006-4f52-813a-7d8f5f97dc87 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.476158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.491439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.492058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.492339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.492616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.493324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:17.493629 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.495014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.503127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 60/116] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:17.503919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.550857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41352-d12a-487c-a7f8-e54684e01097 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.584588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.585251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.585532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.585802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.595910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:17.600322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f15ba3-3b24-4bf2-89f0-f31f3bc888b3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:17.601029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:17.601958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 57/117] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:17.605676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.634173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.634773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.635053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.635324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.636045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] RBAC: Adding query filter params (role.id=ebb01267d6294a78b508f59cff01b63b, scope.project.id=7084cc89abc448658c55aaca1e3c30e4, user.id=717327774a4146f69129e15672f31b53) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:17.636349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.637814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.645122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 61/118] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/role_assignments?user.id=717327774a4146f69129e15672f31b53&scope.project.id=7084cc89abc448658c55aaca1e3c30e4&role.id=ebb01267d6294a78b508f59cff01b63b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:17.645122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.657304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.708821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.717286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4cc7-92ba-4561-afc0-cf849daf7ffc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.760539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.761368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.762020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.762303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.763130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.764725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.772398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e040e44-5d11-4151-95fe-5e26403f5666 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.794311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 58/119] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:58:17 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:17.795462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.824612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.825324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.825606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.825935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.827661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.829306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.831131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 62/120] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:17.832013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:17.934491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.944800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3cf7-bc32-44c5-9c59-794a63b2f988 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.965720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf283c-c16b-405b-b8af-e66e19e43b2b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:17.982985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:17.985278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:17.985931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:17.986209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:17.986636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] PATH_INFO: `/v3/users/717327774a4146f69129e15672f31b53` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:17.988608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] RBAC: Authorizing `identity:get_user(user_id=717327774a4146f69129e15672f31b53)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:17.990049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:17.992096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 59/121] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/users/717327774a4146f69129e15672f31b53 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:17.994086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:18.011927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.012563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.012833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.013154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.013827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:18.014195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.015613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.024807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 63/122] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:18.025861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:18.112687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b88a-e525-4a22-86a1-5a8b7c37fd55 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:18.134165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60379259-62b0-445e-8b29-3a3da3feedce None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:18.152942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.153583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.153978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.154253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.154979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] RBAC: Adding query filter params (role.id=04c3574945c544d08b9e6b4c7ad69561, scope.project.id=7084cc89abc448658c55aaca1e3c30e4, user.id=717327774a4146f69129e15672f31b53) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:18.155285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.156794 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.169016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 60/123] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:17 2022] GET /identity/v3/role_assignments?user.id=717327774a4146f69129e15672f31b53&scope.project.id=7084cc89abc448658c55aaca1e3c30e4&role.id=04c3574945c544d08b9e6b4c7ad69561 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:18.169016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:18.177248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.177981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.178335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.178689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.205656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:18.229743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:18.262091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.264578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.293993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0f20-34c9-4236-959d-0337ac57b99f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:18.343292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.344337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.345096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.345635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] PATH_INFO: `/v3/users/aff62152ac244870a70e6bba6f6fb03f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.362985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] RBAC: Authorizing `identity:get_user(user_id=aff62152ac244870a70e6bba6f6fb03f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.366798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.367321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 61/124] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:18 2022] GET /identity/v3/users/aff62152ac244870a70e6bba6f6fb03f => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:18.373375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:18.404306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 64/125] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:18.410128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:18.481799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:18.500575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:18.502331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5434a-5e79-42c0-9802-248afbaa349b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:18.524529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ec92a-054c-4e60-8524-ccf5b1e92ef1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:18.541365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.542291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.542571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.542845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.543973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.546148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.548529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 62/126] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:18 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:18.553892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:18.558965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.559605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.559886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.560157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] PATH_INFO: `/v3/projects/41f44e6e873d4d1b9bafea1aa089b5c4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.561297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] RBAC: Authorizing `identity:get_project(project_id=41f44e6e873d4d1b9bafea1aa089b5c4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.563308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.564938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 65/127] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:18 2022] GET /identity/v3/projects/41f44e6e873d4d1b9bafea1aa089b5c4 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:18.570649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:18.659099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc67728-c8a0-45a0-9b60-2a39d534a84c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:18.677060 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a1c06-cd30-4b6c-ae7b-c1a87934270c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:18.694637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9ca03-8959-4991-949c-0312c05f9630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.695407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9ca03-8959-4991-949c-0312c05f9630 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.695683 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9ca03-8959-4991-949c-0312c05f9630 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.695953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9ca03-8959-4991-949c-0312c05f9630 None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/aff62152ac244870a70e6bba6f6fb03f/roles/81523fd66bf54f7ba691134a68d0a256` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.697963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9ca03-8959-4991-949c-0312c05f9630 None admin] RBAC: Authorizing `identity:create_grant(project_id=7084cc89abc448658c55aaca1e3c30e4, user_id=aff62152ac244870a70e6bba6f6fb03f, role_id=81523fd66bf54f7ba691134a68d0a256)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.699399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9ca03-8959-4991-949c-0312c05f9630 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.712846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 63/128] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:18 2022] PUT /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4/users/aff62152ac244870a70e6bba6f6fb03f/roles/81523fd66bf54f7ba691134a68d0a256 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:58:18.713016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ee32c-9054-4769-893f-006b3e87a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:18.713328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee32c-9054-4769-893f-006b3e87a43c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:18.713610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee32c-9054-4769-893f-006b3e87a43c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:18.713887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee32c-9054-4769-893f-006b3e87a43c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:18.714616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ee32c-9054-4769-893f-006b3e87a43c None admin] RBAC: Adding query filter params (role.id=ebb01267d6294a78b508f59cff01b63b, scope.project.id=41f44e6e873d4d1b9bafea1aa089b5c4, user.id=717327774a4146f69129e15672f31b53) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:18.714930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ee32c-9054-4769-893f-006b3e87a43c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:18.716417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ee32c-9054-4769-893f-006b3e87a43c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:18.730945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 66/129] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:18 2022] GET /identity/v3/role_assignments?user.id=717327774a4146f69129e15672f31b53&scope.project.id=41f44e6e873d4d1b9bafea1aa089b5c4&role.id=ebb01267d6294a78b508f59cff01b63b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:20.026133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e02c4-1bd2-4f41-92ca-a0db6d160215 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:20.026650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e02c4-1bd2-4f41-92ca-a0db6d160215 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:20.026735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e02c4-1bd2-4f41-92ca-a0db6d160215 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:20.028003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 64/130] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:20.033397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c39a-c2b3-4819-b71a-90a1b5d99ad0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:20.033833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c39a-c2b3-4819-b71a-90a1b5d99ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:20.034079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c39a-c2b3-4819-b71a-90a1b5d99ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:20.052436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5c51c39a-c2b3-4819-b71a-90a1b5d99ad0 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:20.053647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5c51c39a-c2b3-4819-b71a-90a1b5d99ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:20.055578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:20.125537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 67/131] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:20.392565 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e02c4-1bd2-4f41-92ca-a0db6d160215 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:20.407971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:20.496674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e02c4-1bd2-4f41-92ca-a0db6d160215 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:20.530419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91a096-9f87-4204-b0c4-d6abd442854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:20.531102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a096-9f87-4204-b0c4-d6abd442854c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:20.531384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a096-9f87-4204-b0c4-d6abd442854c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:20.531659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a096-9f87-4204-b0c4-d6abd442854c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:20.532755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91a096-9f87-4204-b0c4-d6abd442854c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:20.534235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91a096-9f87-4204-b0c4-d6abd442854c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:20.535792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 65/132] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:20.541305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51c39a-c2b3-4819-b71a-90a1b5d99ad0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:20.637555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51c39a-c2b3-4819-b71a-90a1b5d99ad0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:20.669726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba40e1-8216-490a-aa15-08ececc7c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:20.670276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba40e1-8216-490a-aa15-08ececc7c3fa None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:20.670563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba40e1-8216-490a-aa15-08ececc7c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:20.670840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba40e1-8216-490a-aa15-08ececc7c3fa None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:20.672030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba40e1-8216-490a-aa15-08ececc7c3fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:20.673535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba40e1-8216-490a-aa15-08ececc7c3fa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:20.683613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:20.695220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 68/133] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:20 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:20.862030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346a8d-8241-438f-8831-d630bc82db24 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:20.862321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346a8d-8241-438f-8831-d630bc82db24 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:20.862602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346a8d-8241-438f-8831-d630bc82db24 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:20.863954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 66/134] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:20.869475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961982-7af1-4f0c-9ef5-d61473285a2d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:20.869789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961982-7af1-4f0c-9ef5-d61473285a2d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:20.870062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961982-7af1-4f0c-9ef5-d61473285a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:20.888505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-59961982-7af1-4f0c-9ef5-d61473285a2d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:20.889715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-59961982-7af1-4f0c-9ef5-d61473285a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:20.955982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 69/135] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:21.224193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0346a8d-8241-438f-8831-d630bc82db24 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:21.311686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:21.332326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0346a8d-8241-438f-8831-d630bc82db24 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:21.367633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:21.368627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:21.369136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:21.369617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:21.380397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:21.385567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:21.386399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:21.387248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:21.394805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 67/136] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:21.396369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59961982-7af1-4f0c-9ef5-d61473285a2d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:21.501463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59961982-7af1-4f0c-9ef5-d61473285a2d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:21.526318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:21.539111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:21.539735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:21.540017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:21.540395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:21.541130 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:21.541817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:21.543572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:21.552677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 70/137] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:21.558609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:21.663278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619df6c-ed4e-4bd2-bfbe-d6911ea28705 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:21.699438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:21.700436 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:21.700926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:21.701419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] PATH_INFO: `/v3/users/aff62152ac244870a70e6bba6f6fb03f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:21.702778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] RBAC: Authorizing `identity:get_user(user_id=aff62152ac244870a70e6bba6f6fb03f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:21.704546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:21.711010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 68/138] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:21 2022] GET /identity/v3/users/aff62152ac244870a70e6bba6f6fb03f => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:21.712675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:21.825935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8382505-455f-40c3-a5f9-2975abd5fbfa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:21.861811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:21.862451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:21.862731 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:21.863003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:21.919590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:21.933931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:21.935395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:22.034291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 71/139] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:22.040179 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:22.053434 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:22.144307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1933-f6c4-4d2d-b752-abdd884bdd4d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:22.179780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24851aac-d6ea-4822-b3e4-69f2c1211e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:22.180422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851aac-d6ea-4822-b3e4-69f2c1211e2f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:22.180702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851aac-d6ea-4822-b3e4-69f2c1211e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:22.180991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24851aac-d6ea-4822-b3e4-69f2c1211e2f None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:22.182125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24851aac-d6ea-4822-b3e4-69f2c1211e2f None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:22.183567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24851aac-d6ea-4822-b3e4-69f2c1211e2f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:22.185404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 69/140] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:22 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:22.191502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:22.277602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:22.295106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd2ba-bb4a-4d9c-a204-7cd4321a648f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:22.329888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95230122-3f64-408a-883e-2cd4ac428f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:22.330497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230122-3f64-408a-883e-2cd4ac428f58 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:22.330775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230122-3f64-408a-883e-2cd4ac428f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:22.331046 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95230122-3f64-408a-883e-2cd4ac428f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:22.331777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95230122-3f64-408a-883e-2cd4ac428f58 None admin] RBAC: Adding query filter params (role.id=81523fd66bf54f7ba691134a68d0a256, scope.project.id=7084cc89abc448658c55aaca1e3c30e4, user.id=aff62152ac244870a70e6bba6f6fb03f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:22.332087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95230122-3f64-408a-883e-2cd4ac428f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:22.333554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95230122-3f64-408a-883e-2cd4ac428f58 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:22.339621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 72/141] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:22 2022] GET /identity/v3/role_assignments?user.id=aff62152ac244870a70e6bba6f6fb03f&scope.project.id=7084cc89abc448658c55aaca1e3c30e4&role.id=81523fd66bf54f7ba691134a68d0a256 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:23.141922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a26b88-fc24-40f4-8398-cd28267f24dd None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.142409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a26b88-fc24-40f4-8398-cd28267f24dd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.142409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a26b88-fc24-40f4-8398-cd28267f24dd None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.143383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75c5ba-707f-4ff5-97c2-8724d23bf021 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.143749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75c5ba-707f-4ff5-97c2-8724d23bf021 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.143898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 70/142] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:23.143987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75c5ba-707f-4ff5-97c2-8724d23bf021 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.145288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 73/143] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:23.149229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8119-e538-41ff-b184-60440be724f4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.149527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8119-e538-41ff-b184-60440be724f4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.149805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8119-e538-41ff-b184-60440be724f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.150475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642aa9-7c36-4317-af46-ebd11b026af4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.150824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642aa9-7c36-4317-af46-ebd11b026af4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.151165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642aa9-7c36-4317-af46-ebd11b026af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.168601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9bab8119-e538-41ff-b184-60440be724f4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:23.169531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cd642aa9-7c36-4317-af46-ebd11b026af4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:23.169785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9bab8119-e538-41ff-b184-60440be724f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:23.170676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cd642aa9-7c36-4317-af46-ebd11b026af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:23.235468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 71/144] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:23.236086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 74/145] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:23.236761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60383765-2b7e-47b0-a882-74657d7694ed None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.237083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60383765-2b7e-47b0-a882-74657d7694ed None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.237364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60383765-2b7e-47b0-a882-74657d7694ed None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.238602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 72/146] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:23.246451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8937-27af-496c-8079-175cce14a3ed None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.246741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8937-27af-496c-8079-175cce14a3ed None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.247018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8937-27af-496c-8079-175cce14a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.264659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-589a8937-27af-496c-8079-175cce14a3ed None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:23.265874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-589a8937-27af-496c-8079-175cce14a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:23.332061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 75/147] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:23.501646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60383765-2b7e-47b0-a882-74657d7694ed None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:23.502594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8937-27af-496c-8079-175cce14a3ed None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:23.512415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:23.515796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:23.610665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60383765-2b7e-47b0-a882-74657d7694ed None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:23.613375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8937-27af-496c-8079-175cce14a3ed None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:23.644151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:23.644783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.645095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.645371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.649150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:23.649808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.650067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.650339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.655277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:23.660682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:23.661549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:23.664727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:23.665565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:23.665648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 73/148] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:58:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:23.665648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:23.665985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:23.667057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:23.668182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 76/149] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:23.670796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:23.731956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:23.740620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:23.766589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676d8e-9c91-4d22-b4eb-d231a8175b3d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:23.771528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67a29-1c53-48ff-8325-f4b555dab21a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:23.799850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:23.800483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.800765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.801066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.802160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:23.803598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:23.804323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:23.804921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.805196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 74/150] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:23.809835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.809835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.809964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:23.810031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:23.810031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:23.810031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:23.819094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 77/151] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:58:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:23.819939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:23.902519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464c2e-1c24-4a82-b9a6-277f09db30b9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:23.919226 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2351c70-5502-4c19-9d08-d16389e42a1a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:23.936671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:23.937853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.938135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.938409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.939070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:23.939370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:23.940727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:23.942950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:23.948123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:23.949427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 75/152] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:23.950036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:23.957450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:23.958060 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:23.958364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:23.958634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:23.959283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:23.960728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:23.982409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 78/153] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:23 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:23.983287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:24.068782 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c68c4-f591-4c77-8922-47dd9f0b0cbb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.098112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046ecb5-4bd8-4f49-b77e-7ab584953c69 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.109573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.110245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.110524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.110799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] PATH_INFO: `/v3/users/00dcae490a28428ea6f3dcad290e5d32` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.126789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] RBAC: Authorizing `identity:get_user(user_id=00dcae490a28428ea6f3dcad290e5d32)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.128264 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.130795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 76/154] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:23 2022] GET /identity/v3/users/00dcae490a28428ea6f3dcad290e5d32 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:24.136272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:24.143808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.144462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.144741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.145038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] PATH_INFO: `/v3/users/00dcae490a28428ea6f3dcad290e5d32` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.146211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] RBAC: Authorizing `identity:get_user(user_id=00dcae490a28428ea6f3dcad290e5d32)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.147670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.149519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 79/155] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:23 2022] GET /identity/v3/users/00dcae490a28428ea6f3dcad290e5d32 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:24.154776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:24.201907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:24.230745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:24.259570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72169-62e5-429e-889d-d0e3e5b8e8ef None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.298215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b68be-058f-4240-8f3b-8bdc05b151ed None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.298670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.299305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.299679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.299882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.301628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.302457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.304281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 77/156] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:24 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:24.309844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:24.344297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.345286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.345576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.345852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.346997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.348456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.350796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 80/157] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:24 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:24.357441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:24.429473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c5f3-17af-41a6-b5d8-bc20ea282ff3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.459163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:24.471125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488abb1-0fa8-41f7-be52-97c7becc414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.471795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488abb1-0fa8-41f7-be52-97c7becc414a None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.472122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488abb1-0fa8-41f7-be52-97c7becc414a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.472403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488abb1-0fa8-41f7-be52-97c7becc414a None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/00dcae490a28428ea6f3dcad290e5d32/roles/04c3574945c544d08b9e6b4c7ad69561` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.474631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488abb1-0fa8-41f7-be52-97c7becc414a None admin] RBAC: Authorizing `identity:create_grant(project_id=52cd6fc119584a5b9eb97fe528335ca1, user_id=00dcae490a28428ea6f3dcad290e5d32, role_id=04c3574945c544d08b9e6b4c7ad69561)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.476340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488abb1-0fa8-41f7-be52-97c7becc414a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.487871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f59e7-067a-4686-9f6b-a1c2185b19a7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.497011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 78/158] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:24 2022] PUT /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/00dcae490a28428ea6f3dcad290e5d32/roles/04c3574945c544d08b9e6b4c7ad69561 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:58:24.519707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:24.534770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e83ba1-d848-4b89-85cd-2e46ac34e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.535561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e83ba1-d848-4b89-85cd-2e46ac34e9ad None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.535850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e83ba1-d848-4b89-85cd-2e46ac34e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.536123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e83ba1-d848-4b89-85cd-2e46ac34e9ad None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/00dcae490a28428ea6f3dcad290e5d32/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.538206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e83ba1-d848-4b89-85cd-2e46ac34e9ad None admin] RBAC: Authorizing `identity:create_grant(project_id=52cd6fc119584a5b9eb97fe528335ca1, user_id=00dcae490a28428ea6f3dcad290e5d32, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.539911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e83ba1-d848-4b89-85cd-2e46ac34e9ad None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.555315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 81/159] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:24 2022] PUT /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/00dcae490a28428ea6f3dcad290e5d32/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:26.254393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d29d6-bfa0-4749-baa9-757da9829e8f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.254962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d29d6-bfa0-4749-baa9-757da9829e8f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.254962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d29d6-bfa0-4749-baa9-757da9829e8f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.256334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 79/160] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:26.262560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f924f-a785-4566-9060-26f83a590a51 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.263554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f924f-a785-4566-9060-26f83a590a51 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.264052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f924f-a785-4566-9060-26f83a590a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.284966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ae6f924f-a785-4566-9060-26f83a590a51 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:26.286561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ae6f924f-a785-4566-9060-26f83a590a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.359430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 82/161] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:26.387937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c01a3-9737-45ae-a197-e02e5f60d3c4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.387937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c01a3-9737-45ae-a197-e02e5f60d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.387937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c01a3-9737-45ae-a197-e02e5f60d3c4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.387937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 80/162] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:26.393722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b30d4-a3cb-4c5a-8553-676c29b35dfb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.394007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b30d4-a3cb-4c5a-8553-676c29b35dfb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.394279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b30d4-a3cb-4c5a-8553-676c29b35dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.413008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a86b30d4-a3cb-4c5a-8553-676c29b35dfb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:26.414213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a86b30d4-a3cb-4c5a-8553-676c29b35dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.484798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 83/163] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:26.636708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c01a3-9737-45ae-a197-e02e5f60d3c4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:26.704283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265e53-7f4f-4771-9cbe-3d7b1f6692d4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.704671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265e53-7f4f-4771-9cbe-3d7b1f6692d4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.704859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265e53-7f4f-4771-9cbe-3d7b1f6692d4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.706338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 84/164] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:26.711324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa2393-a108-45b6-9d77-249d70c4dc3c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.713113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa2393-a108-45b6-9d77-249d70c4dc3c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.713113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa2393-a108-45b6-9d77-249d70c4dc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.731477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-61aa2393-a108-45b6-9d77-249d70c4dc3c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:26.732724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-61aa2393-a108-45b6-9d77-249d70c4dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.759194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c01a3-9737-45ae-a197-e02e5f60d3c4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:26.784865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:26.796966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c69a6d-6927-4d14-bd01-7dc18e7f9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:26.797632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c69a6d-6927-4d14-bd01-7dc18e7f9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.797914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c69a6d-6927-4d14-bd01-7dc18e7f9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.798186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c69a6d-6927-4d14-bd01-7dc18e7f9bb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.808197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c69a6d-6927-4d14-bd01-7dc18e7f9bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:26.813354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 85/165] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b7c69a6d-6927-4d14-bd01-7dc18e7f9bb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:26.813741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:26.814646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:26.815478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 81/166] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:26.816235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3ac0-3e8f-4210-9fc2-11d0c35116ec None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.816756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3ac0-3e8f-4210-9fc2-11d0c35116ec None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.816756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3ac0-3e8f-4210-9fc2-11d0c35116ec None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.818019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 82/167] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:26.820463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa2393-a108-45b6-9d77-249d70c4dc3c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:26.821672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3ac0-3e8f-4210-9fc2-11d0c35116ec None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:26.872099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:26.928920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa2393-a108-45b6-9d77-249d70c4dc3c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:26.932594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3ac0-3e8f-4210-9fc2-11d0c35116ec None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:26.965716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed98e5-c3f1-4d93-94ae-57129f6760de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:26.966616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed98e5-c3f1-4d93-94ae-57129f6760de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.967045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed98e5-c3f1-4d93-94ae-57129f6760de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.967536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed98e5-c3f1-4d93-94ae-57129f6760de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.967817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:26.968920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.969238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.969507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.969983 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed98e5-c3f1-4d93-94ae-57129f6760de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:26.970162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:26.970462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:26.971836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:26.972010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed98e5-c3f1-4d93-94ae-57129f6760de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:26.973811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 86/168] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:26.979251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed67a2-a52b-42a0-b37c-6312c0a81e06 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.979546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed67a2-a52b-42a0-b37c-6312c0a81e06 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.979834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed67a2-a52b-42a0-b37c-6312c0a81e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.980849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 83/169] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:26.985574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.001140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-41ed67a2-a52b-42a0-b37c-6312c0a81e06 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:27.002325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-41ed67a2-a52b-42a0-b37c-6312c0a81e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:27.038914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.072525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 87/170] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:27.078379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed67a2-a52b-42a0-b37c-6312c0a81e06 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.086241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bca09-e536-49b0-9805-1cba54ad8737 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.094307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.127208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.127822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.128098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.128525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.129208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.130649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.157086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 84/171] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:26 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:27.157086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.197640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed67a2-a52b-42a0-b37c-6312c0a81e06 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.235933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.236500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.236778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.237190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] PATH_INFO: `/v3/users/b254791406f94b0389c39d21e958b4da` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.253547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] RBAC: Authorizing `identity:get_user(user_id=b254791406f94b0389c39d21e958b4da)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.255285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.257159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 88/172] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/users/b254791406f94b0389c39d21e958b4da => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:27.263051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.286873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbdd55-8302-4d24-b3a3-bb2894787bdb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.310503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.331173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.332388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.332758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.333152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.347609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:27.353289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:27.354195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 85/173] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:27.355514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.383944 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.403123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf585-2daa-4845-afed-c86a402ee054 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.442565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.443210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.443497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.443772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.445423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.447149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.448675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 89/174] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:27.450067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.481366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac624d9-ca9e-4b02-8650-61dd4650099d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.521847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.522943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.523337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.523613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.538532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:27.544878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:27.545797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:27.546637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 86/175] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:27.547295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.574122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.579097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a1660-8ac8-438f-980b-0581b7fb8714 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.624801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.625890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.626407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.626890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.627791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:27.628295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.629981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.638758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 90/176] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:27.639961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.653635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.683031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82595-6ea5-4f78-aee0-46dc01652b12 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.723265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.723939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.724221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.724493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/b254791406f94b0389c39d21e958b4da/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.727319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=52cd6fc119584a5b9eb97fe528335ca1, user_id=b254791406f94b0389c39d21e958b4da, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.728808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.746841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 87/177] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:27 2022] PUT /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/b254791406f94b0389c39d21e958b4da/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:27.747762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.756714 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d65a1-66df-49ec-b36c-a7dbb92d9d87 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.798649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.799656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.800153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.800700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.801649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:27.802313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.804235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.814848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 91/178] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:27.821067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.854137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.883160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb1aec-4287-48bc-9161-5af2b1e3b7b8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.923439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.924433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.925086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.925553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] PATH_INFO: `/v3/users/00dcae490a28428ea6f3dcad290e5d32` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.927045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] RBAC: Authorizing `identity:get_user(user_id=00dcae490a28428ea6f3dcad290e5d32)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.928813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.930830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 88/179] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/users/00dcae490a28428ea6f3dcad290e5d32 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:27.942192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.953279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f313f2-c281-4638-89f0-055ce8a643e5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.977397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.998106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.999314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.999602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.000027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] PATH_INFO: `/v3/users/00dcae490a28428ea6f3dcad290e5d32` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.001472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] RBAC: Authorizing `identity:get_user(user_id=00dcae490a28428ea6f3dcad290e5d32)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.003489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.005159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 92/180] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/users/00dcae490a28428ea6f3dcad290e5d32 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:28.010791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:28.064802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4d51-7bd6-4c1b-8e07-69df1c40c26c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.102984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.103941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.104372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.104743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.116904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:28.126652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849276-919c-472c-892b-c862e1dc6576 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.164683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.165443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.165797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.166148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.196306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.198011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.225615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:28.238638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.240131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.309081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 89/181] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:28.318413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:28.340027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:28.356765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 93/182] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:28.358120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:28.471152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f752db-62b4-457a-8277-b3ac3f979b9d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.508092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69c00-2b4e-4fea-83c0-36ad9073a7ea None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.525455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:28.544777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.545499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.545777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.546819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.548210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.550116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.551854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 90/183] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:28 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:28.557902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:28.598433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.599000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.599271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.599536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.601759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.603234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.604893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 94/184] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:28 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:28.614214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:28.731043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:28.731231 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3aa6cc-f106-4b13-8040-1cc04f44df71 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.800316 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828eeb1-e06c-4281-b4a0-eb098f13af33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.800935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828eeb1-e06c-4281-b4a0-eb098f13af33 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.801233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828eeb1-e06c-4281-b4a0-eb098f13af33 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.801499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828eeb1-e06c-4281-b4a0-eb098f13af33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.802230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828eeb1-e06c-4281-b4a0-eb098f13af33 None admin] RBAC: Adding query filter params (role.id=04c3574945c544d08b9e6b4c7ad69561, scope.project.id=52cd6fc119584a5b9eb97fe528335ca1, user.id=00dcae490a28428ea6f3dcad290e5d32) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:28.802531 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828eeb1-e06c-4281-b4a0-eb098f13af33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.804114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828eeb1-e06c-4281-b4a0-eb098f13af33 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.813072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b78f-210b-4512-b59e-31191e4af871 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.819680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 91/185] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:28 2022] GET /identity/v3/role_assignments?user.id=00dcae490a28428ea6f3dcad290e5d32&scope.project.id=52cd6fc119584a5b9eb97fe528335ca1&role.id=04c3574945c544d08b9e6b4c7ad69561 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:28.880260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34500577-e962-4a35-9fa4-601259fc8162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.881279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34500577-e962-4a35-9fa4-601259fc8162 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.893491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34500577-e962-4a35-9fa4-601259fc8162 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.894174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34500577-e962-4a35-9fa4-601259fc8162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.895201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34500577-e962-4a35-9fa4-601259fc8162 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=52cd6fc119584a5b9eb97fe528335ca1, user.id=00dcae490a28428ea6f3dcad290e5d32) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:28.895725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34500577-e962-4a35-9fa4-601259fc8162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.897465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34500577-e962-4a35-9fa4-601259fc8162 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.905872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 95/186] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:28 2022] GET /identity/v3/role_assignments?user.id=00dcae490a28428ea6f3dcad290e5d32&scope.project.id=52cd6fc119584a5b9eb97fe528335ca1&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:29.830536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdd600-ce56-4dcb-b337-f2bac9b0cb17 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:29.831054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdd600-ce56-4dcb-b337-f2bac9b0cb17 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:29.831054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdd600-ce56-4dcb-b337-f2bac9b0cb17 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:29.832560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 92/187] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:29.835173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0aa7-c3d4-47d7-9ae9-1fb3d142b7ba None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:29.835583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0aa7-c3d4-47d7-9ae9-1fb3d142b7ba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:29.835722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0aa7-c3d4-47d7-9ae9-1fb3d142b7ba None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:29.837266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315159-7a10-40c8-9c83-f50e0f3dc948 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:29.837643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315159-7a10-40c8-9c83-f50e0f3dc948 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:29.837762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 96/188] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:29.837844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315159-7a10-40c8-9c83-f50e0f3dc948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:29.842544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8378-437b-4fc3-8236-af003676b35c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:29.843341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8378-437b-4fc3-8236-af003676b35c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:29.843620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8378-437b-4fc3-8236-af003676b35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:29.856707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f9315159-7a10-40c8-9c83-f50e0f3dc948 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:29.857930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f9315159-7a10-40c8-9c83-f50e0f3dc948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:29.862466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-84eb8378-437b-4fc3-8236-af003676b35c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:29.863755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-84eb8378-437b-4fc3-8236-af003676b35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:29.896373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:29.930669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 97/189] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:29.932937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 93/190] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:30.200107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315159-7a10-40c8-9c83-f50e0f3dc948 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.200292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb8378-437b-4fc3-8236-af003676b35c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.255420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:30.305013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb8378-437b-4fc3-8236-af003676b35c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:30.308865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315159-7a10-40c8-9c83-f50e0f3dc948 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:30.342221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:30.342974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.343255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.343527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.349075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:30.349810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.350451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.350707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.351908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:30.353384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:30.354088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:30.357016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 94/191] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:30.359630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:30.360524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:30.361734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 98/192] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:30.363490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.366354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.408117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:30.464222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7599d-234f-4e0d-855a-02f8a2044ce2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:30.467313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42a08-62ce-451d-97de-af775179d16d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:30.478395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:30.499587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594e20c-ec9f-45ca-851e-dc7988c21d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:30.500191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594e20c-ec9f-45ca-851e-dc7988c21d70 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.500466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594e20c-ec9f-45ca-851e-dc7988c21d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.500735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594e20c-ec9f-45ca-851e-dc7988c21d70 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.501427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594e20c-ec9f-45ca-851e-dc7988c21d70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:30.501724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594e20c-ec9f-45ca-851e-dc7988c21d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:30.501818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8ca09-f011-4f3b-8458-7923d625e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:30.502393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ca09-f011-4f3b-8458-7923d625e2dc None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.502670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ca09-f011-4f3b-8458-7923d625e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.502942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ca09-f011-4f3b-8458-7923d625e2dc None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.503103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594e20c-ec9f-45ca-851e-dc7988c21d70 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:30.503601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8ca09-f011-4f3b-8458-7923d625e2dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:30.505030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8ca09-f011-4f3b-8458-7923d625e2dc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:30.512251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 99/193] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:30.512383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bec66-e343-4edb-90dc-ee681243f6c5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.512579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bec66-e343-4edb-90dc-ee681243f6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.512853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bec66-e343-4edb-90dc-ee681243f6c5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.514076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 100/194] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:30.517004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bec66-e343-4edb-90dc-ee681243f6c5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.526819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 95/195] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:30 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:30.528039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc4f1-7805-4d38-84dc-f36911c46e39 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.528331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc4f1-7805-4d38-84dc-f36911c46e39 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.528604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc4f1-7805-4d38-84dc-f36911c46e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.557409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5bdcc4f1-7805-4d38-84dc-f36911c46e39 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:30.558645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5bdcc4f1-7805-4d38-84dc-f36911c46e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:30.629578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bec66-e343-4edb-90dc-ee681243f6c5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:30.630388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 96/196] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:30.668690 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:30.669800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.670323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.670799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] PATH_INFO: `/v3/users/9ea400a2b1b54a40a1056c546b104c2f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.687530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] RBAC: Authorizing `identity:get_user(user_id=9ea400a2b1b54a40a1056c546b104c2f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:30.689449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:30.691457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 101/197] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:30 2022] GET /identity/v3/users/9ea400a2b1b54a40a1056c546b104c2f => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:30.697083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcc4f1-7805-4d38-84dc-f36911c46e39 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.727842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:30.805401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcc4f1-7805-4d38-84dc-f36911c46e39 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:30.844199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:30.844926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:30.845166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:30.845433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:30.847298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:30.848808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:30.850743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 97/198] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:30 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:30.856574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.892275 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:30.912073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:30.968638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f63f16-25a6-4546-96fb-cbbc92b1abae None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:31.004844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:31.005677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:31.006046 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:31.006417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/9ea400a2b1b54a40a1056c546b104c2f/roles/81523fd66bf54f7ba691134a68d0a256` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:31.008383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] RBAC: Authorizing `identity:create_grant(project_id=52cd6fc119584a5b9eb97fe528335ca1, user_id=9ea400a2b1b54a40a1056c546b104c2f, role_id=81523fd66bf54f7ba691134a68d0a256)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:31.009930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:31.028999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 102/199] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:58:30 2022] PUT /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/users/9ea400a2b1b54a40a1056c546b104c2f/roles/81523fd66bf54f7ba691134a68d0a256 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:31.034728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:31.043826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b930-a88a-4a80-961d-a036488ef1b5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:31.085024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:31.085731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:31.086007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:31.086274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:31.098773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:31.104175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:31.105166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:31.106340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 98/200] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:58:31.111841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:31.219832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:31.234471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c11f-99d7-4a83-b61a-273ecbde655e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:31.272456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:31.276996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:31.276996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:31.276996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:31.276996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:31.276996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:31.276996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:31.285553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 103/201] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:31.291323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:31.395216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1290f-ac56-4fd0-985d-4c4bd5572b01 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:31.429855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:31.430555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:31.430893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:31.431167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] PATH_INFO: `/v3/users/b254791406f94b0389c39d21e958b4da` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:31.432313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] RBAC: Authorizing `identity:get_user(user_id=b254791406f94b0389c39d21e958b4da)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:31.433809 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:31.435394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 99/202] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:31 2022] GET /identity/v3/users/b254791406f94b0389c39d21e958b4da => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:31.441562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:31.551745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a961a4-5b21-4350-8514-5a439dc7fdf4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:31.588840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:31.589823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:31.590322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:31.590807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:31.619075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:31.666906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:31.668707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:31.770180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 104/203] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:31.775527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:31.817322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:31.880210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37ef2d-3e7a-4b78-9bbd-9fbbe52016b0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:31.915952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5b1e9-877d-4221-869b-518582eeb04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:31.916584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5b1e9-877d-4221-869b-518582eeb04a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:31.916862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5b1e9-877d-4221-869b-518582eeb04a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:31.917163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5b1e9-877d-4221-869b-518582eeb04a None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:31.918278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5b1e9-877d-4221-869b-518582eeb04a None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:31.919815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5b1e9-877d-4221-869b-518582eeb04a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:31.921808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 100/204] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:31 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:31.927658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:31.985036 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:32.035568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f1e0-dc81-40fb-a595-0add3dddc522 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:32.071040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0397b4c-51db-43a7-89d6-1d0256823ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:32.071566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397b4c-51db-43a7-89d6-1d0256823ecb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:32.071843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397b4c-51db-43a7-89d6-1d0256823ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:32.072109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397b4c-51db-43a7-89d6-1d0256823ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:32.072888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0397b4c-51db-43a7-89d6-1d0256823ecb None admin] RBAC: Adding query filter params (role.id=ebb01267d6294a78b508f59cff01b63b, scope.project.id=52cd6fc119584a5b9eb97fe528335ca1, user.id=b254791406f94b0389c39d21e958b4da) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:32.073219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0397b4c-51db-43a7-89d6-1d0256823ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:32.074760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0397b4c-51db-43a7-89d6-1d0256823ecb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:32.082628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 105/205] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:31 2022] GET /identity/v3/role_assignments?user.id=b254791406f94b0389c39d21e958b4da&scope.project.id=52cd6fc119584a5b9eb97fe528335ca1&role.id=ebb01267d6294a78b508f59cff01b63b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:32.896012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b8fe-43cb-421b-8655-71eb21aaf027 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:32.896526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b8fe-43cb-421b-8655-71eb21aaf027 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:32.896629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b8fe-43cb-421b-8655-71eb21aaf027 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:32.898059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 101/206] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:32.903139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec996-a6bc-493c-932d-f667eeeba4f0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:32.903433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec996-a6bc-493c-932d-f667eeeba4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:32.903705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec996-a6bc-493c-932d-f667eeeba4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:32.906347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73857e0-128f-4e86-ae5c-5df617a7e0e3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:32.906632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73857e0-128f-4e86-ae5c-5df617a7e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:32.906935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73857e0-128f-4e86-ae5c-5df617a7e0e3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:32.908256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 102/207] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:32.913180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849ad8-4b72-4b6e-9aef-b1b4e8c8c412 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:32.913459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849ad8-4b72-4b6e-9aef-b1b4e8c8c412 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:32.913728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50849ad8-4b72-4b6e-9aef-b1b4e8c8c412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:32.922308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ca6ec996-a6bc-493c-932d-f667eeeba4f0 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:32.923488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca6ec996-a6bc-493c-932d-f667eeeba4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:32.931459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-50849ad8-4b72-4b6e-9aef-b1b4e8c8c412 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:32.932597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-50849ad8-4b72-4b6e-9aef-b1b4e8c8c412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:32.992205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 106/208] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:33.002460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 103/209] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:33.262939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ec996-a6bc-493c-932d-f667eeeba4f0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:33.277166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849ad8-4b72-4b6e-9aef-b1b4e8c8c412 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:33.312032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:33.314468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:33.365747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ec996-a6bc-493c-932d-f667eeeba4f0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:33.398858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06130453-eec6-4fa1-97b5-02fd55fb2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:33.399489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06130453-eec6-4fa1-97b5-02fd55fb2aff None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.399770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06130453-eec6-4fa1-97b5-02fd55fb2aff None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.400041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06130453-eec6-4fa1-97b5-02fd55fb2aff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:33.401173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06130453-eec6-4fa1-97b5-02fd55fb2aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:33.402609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06130453-eec6-4fa1-97b5-02fd55fb2aff None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:33.402696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50849ad8-4b72-4b6e-9aef-b1b4e8c8c412 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:33.404176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 107/210] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:33.406291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559054db-61c0-4166-9bc4-c04fd264b308 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.406575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559054db-61c0-4166-9bc4-c04fd264b308 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.406847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559054db-61c0-4166-9bc4-c04fd264b308 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:33.408228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 108/211] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:33.409511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559054db-61c0-4166-9bc4-c04fd264b308 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:33.436079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27dbd0-5675-4cf4-afc4-97dd3d435def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:33.436790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27dbd0-5675-4cf4-afc4-97dd3d435def None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.437095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27dbd0-5675-4cf4-afc4-97dd3d435def None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.437362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27dbd0-5675-4cf4-afc4-97dd3d435def None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:33.447005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27dbd0-5675-4cf4-afc4-97dd3d435def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4f27dbd0-5675-4cf4-afc4-97dd3d435def None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:33.451832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:33.453153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:33.454003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 104/212] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:33.454690 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e99f1-6c32-491b-820b-f4e9185dd5a7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.454690 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e99f1-6c32-491b-820b-f4e9185dd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.454910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e99f1-6c32-491b-820b-f4e9185dd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:33.472391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c79e99f1-6c32-491b-820b-f4e9185dd5a7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:33.473576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c79e99f1-6c32-491b-820b-f4e9185dd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:33.511011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559054db-61c0-4166-9bc4-c04fd264b308 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:33.527293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:33.538969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 105/213] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:33.544381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:33.544998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.545289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.545386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e99f1-6c32-491b-820b-f4e9185dd5a7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:33.545558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:33.546225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:33.547659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:33.558002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:33.569725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 109/214] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:33 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:58:33.656285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e99f1-6c32-491b-820b-f4e9185dd5a7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:33.693052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:33.693686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.693967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.694240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:33.694925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:33.695255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:33.696681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:33.706938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 106/215] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:33.713100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:33.809383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:33.826563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eb2a0-72a3-4ccc-bd4c-0ebb4b82e9eb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:33.867748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:33.868396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.868675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.868946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] PATH_INFO: `/v3/users/5310190e53a14addb9b08513e7fb3857` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:33.886668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] RBAC: Authorizing `identity:get_user(user_id=5310190e53a14addb9b08513e7fb3857)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:33.888313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:33.890763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 110/216] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:33 2022] GET /identity/v3/users/5310190e53a14addb9b08513e7fb3857 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:33.896603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:33.902212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:33.928896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:33.946055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac7981-32e4-44ec-8d0c-8081f7c6bcf3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:33.995274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:33.996400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:33.996876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:33.997366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:34.010946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:34.012313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b66bb-138f-42ee-9800-55ae0a350f3e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:34.017706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:34.018586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:34.019378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:34.026676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 107/217] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:34.028930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:34.049540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:34.050162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:34.050448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:34.050725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:34.051496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] RBAC: Adding query filter params (role.id=ebb01267d6294a78b508f59cff01b63b, user.id=5310190e53a14addb9b08513e7fb3857, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:34.051778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:34.053255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:34.059366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 111/218] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Oct 23 01:58:33 2022] GET /identity/v3/role_assignments?user.id=5310190e53a14addb9b08513e7fb3857&scope.system=all&role.id=ebb01267d6294a78b508f59cff01b63b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:34.164368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4a33-3cb3-4350-966b-9700df0ec0d9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:34.198555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:34.205388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:34.206379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:34.206860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:34.207354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:34.208247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:34.208756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:34.210443 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:34.225381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 108/219] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:34.227635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:34.325858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:34.332859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0c5e-ad41-4e3c-bb5b-917b7a3db985 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:34.368666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:34.369259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:34.369593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:34.369869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] PATH_INFO: `/v3/users/9ea400a2b1b54a40a1056c546b104c2f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:34.371005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] RBAC: Authorizing `identity:get_user(user_id=9ea400a2b1b54a40a1056c546b104c2f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:34.372478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:34.374784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 112/220] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:34 2022] GET /identity/v3/users/9ea400a2b1b54a40a1056c546b104c2f => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:34.380352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:34.490665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454592e-7ec7-4821-9566-d879ad39711a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:34.528280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:34.528907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:34.529234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:34.529506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:34.594153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:34.603164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:34.604680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:34.715360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 109/221] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:34.721173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:34.821609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b59b1-d4f6-4417-92b8-e45848c5d2c7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:34.856058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eb4f6-dd49-4536-b08c-b6ac7c76563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:34.856695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eb4f6-dd49-4536-b08c-b6ac7c76563b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:34.856988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eb4f6-dd49-4536-b08c-b6ac7c76563b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:34.857267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eb4f6-dd49-4536-b08c-b6ac7c76563b None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:34.858931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eb4f6-dd49-4536-b08c-b6ac7c76563b None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:34.860371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eb4f6-dd49-4536-b08c-b6ac7c76563b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:34.867004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 113/222] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:34 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:34.868421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:34.963566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:34.971747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eaaf8-6440-4ec0-9a99-42a393276bd9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:35.010929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70b4e4-f7d7-44a6-aacc-c9fbe6c8f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:35.011756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70b4e4-f7d7-44a6-aacc-c9fbe6c8f397 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:35.012073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70b4e4-f7d7-44a6-aacc-c9fbe6c8f397 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:35.012344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70b4e4-f7d7-44a6-aacc-c9fbe6c8f397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:35.013100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70b4e4-f7d7-44a6-aacc-c9fbe6c8f397 None admin] RBAC: Adding query filter params (role.id=81523fd66bf54f7ba691134a68d0a256, scope.project.id=52cd6fc119584a5b9eb97fe528335ca1, user.id=9ea400a2b1b54a40a1056c546b104c2f) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:35.013408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70b4e4-f7d7-44a6-aacc-c9fbe6c8f397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:35.014901 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70b4e4-f7d7-44a6-aacc-c9fbe6c8f397 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:35.020956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 110/223] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:58:34 2022] GET /identity/v3/role_assignments?user.id=9ea400a2b1b54a40a1056c546b104c2f&scope.project.id=52cd6fc119584a5b9eb97fe528335ca1&role.id=81523fd66bf54f7ba691134a68d0a256 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:35.966427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783948-fd28-4de8-88fc-ea5d773f3365 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:35.966944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783948-fd28-4de8-88fc-ea5d773f3365 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:35.967020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783948-fd28-4de8-88fc-ea5d773f3365 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:35.968857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 114/224] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:35.974244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd0f5-ce40-41b2-ab94-d7406b833093 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:35.974661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd0f5-ce40-41b2-ab94-d7406b833093 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:35.974843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd0f5-ce40-41b2-ab94-d7406b833093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:35.980905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961718f-b7eb-45a9-9df8-1a38a35fe477 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:35.981421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961718f-b7eb-45a9-9df8-1a38a35fe477 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:35.981532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961718f-b7eb-45a9-9df8-1a38a35fe477 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:35.983518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 115/225] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:35.987718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c9d7-63d6-49d5-850f-0b86bf730a9a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:35.988002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c9d7-63d6-49d5-850f-0b86bf730a9a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:35.988276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c9d7-63d6-49d5-850f-0b86bf730a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:35.994087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ef1dd0f5-ce40-41b2-ab94-d7406b833093 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:35.996328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ef1dd0f5-ce40-41b2-ab94-d7406b833093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:36.006295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-be17c9d7-63d6-49d5-850f-0b86bf730a9a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:36.007460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-be17c9d7-63d6-49d5-850f-0b86bf730a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:36.031962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:36.069976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 111/226] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:36.076648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 116/227] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:36.238209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bba6-d20d-430a-b929-82a597eb6d57 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.238493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bba6-d20d-430a-b929-82a597eb6d57 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.238685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bba6-d20d-430a-b929-82a597eb6d57 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.240178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 112/228] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:36.245225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5a608-adca-4a90-a0d2-2292176f9249 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.245509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5a608-adca-4a90-a0d2-2292176f9249 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.245778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5a608-adca-4a90-a0d2-2292176f9249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.263697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-45c5a608-adca-4a90-a0d2-2292176f9249 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:36.265441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-45c5a608-adca-4a90-a0d2-2292176f9249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:36.332084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 117/229] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:36.336714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bba6-d20d-430a-b929-82a597eb6d57 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.348897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5a608-adca-4a90-a0d2-2292176f9249 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.436898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:36.444153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:36.454473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bba6-d20d-430a-b929-82a597eb6d57 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.454652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5a608-adca-4a90-a0d2-2292176f9249 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.488672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:36.489290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.489570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.489843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.490949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:36.492448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:36.494204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 118/230] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:36.495075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:36.495709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.495983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.496250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.499875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.507460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:36.512265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:36.513195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:36.513983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 113/231] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:58:36.519677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.601835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f60346-a0c5-4b20-a13b-89f077241e3e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.629710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925803-10d4-4a05-85c7-b10878e207e5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.635606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:36.636223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.636506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.636781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] PATH_INFO: `/v3/groups` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.637443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:36.638877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:36.654670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 119/232] 10.222.0.25 () {60 vars in 1134 bytes} [Sun Oct 23 01:58:36 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:58:36.662079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.664688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:36.665366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.665644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.665915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.666597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:36.666899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:36.668330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:36.683455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 114/233] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:36.683985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:36.684460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.699484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:36.783625 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68970561-15a5-4eb3-a4ff-1fe79d73658d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.803375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cba75e-b1eb-42d9-ad9c-e341d82687e5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.821667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:36.822388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.822671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.822936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.838088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:36.842783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:36.843421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.843707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.844512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] PATH_INFO: `/v3/users/6d71629aa8fc4168aae2c8cbf37701bb` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:36.845261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:36.846126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:36.846930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 120/234] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:36.852297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.861865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] RBAC: Authorizing `identity:get_user(user_id=6d71629aa8fc4168aae2c8cbf37701bb)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:36.861865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:36.862982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 115/235] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:36 2022] GET /identity/v3/users/6d71629aa8fc4168aae2c8cbf37701bb => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:36.868857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:36.931720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:36.941273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:36.955821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf179-a5c3-4f9b-8ee8-4c47d0bcad25 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.977462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae8850-228c-4857-ae30-77289b63dc29 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:36.990827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:36.991439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:36.991714 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:36.991982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:36.992649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:36.992949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:36.994370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:37.003133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 121/236] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:37.008473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:37.020028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:37.020650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:37.020917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:37.021214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:37.021936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] RBAC: Adding query filter params (role.id=81523fd66bf54f7ba691134a68d0a256, user.id=6d71629aa8fc4168aae2c8cbf37701bb, scope.system=all) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:37.022236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:37.023653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:37.037924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 116/237] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Oct 23 01:58:36 2022] GET /identity/v3/role_assignments?user.id=6d71629aa8fc4168aae2c8cbf37701bb&scope.system=all&role.id=81523fd66bf54f7ba691134a68d0a256 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:37.121917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe9ca1-c4bc-4b21-a74e-06cbe7a9616e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:37.158263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d819-0100-48c5-a088-6b6aff9a2494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:37.158920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d819-0100-48c5-a088-6b6aff9a2494 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:37.160847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d819-0100-48c5-a088-6b6aff9a2494 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:37.160847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d819-0100-48c5-a088-6b6aff9a2494 None admin] PATH_INFO: `/v3/users/5310190e53a14addb9b08513e7fb3857` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:37.161872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d819-0100-48c5-a088-6b6aff9a2494 None admin] RBAC: Authorizing `identity:get_user(user_id=5310190e53a14addb9b08513e7fb3857)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:37.163389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d819-0100-48c5-a088-6b6aff9a2494 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:37.169000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 122/238] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:37 2022] GET /identity/v3/users/5310190e53a14addb9b08513e7fb3857 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:37.171762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:37.280851 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2971d-6a7a-4555-9227-bce3e6f2a818 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:37.309600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:37.316043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1967b36-9e79-456b-bfab-0c3302892890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:37.316698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967b36-9e79-456b-bfab-0c3302892890 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:37.316992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967b36-9e79-456b-bfab-0c3302892890 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:37.317269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967b36-9e79-456b-bfab-0c3302892890 None admin] PATH_INFO: `/v3/system/users/5310190e53a14addb9b08513e7fb3857/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:37.318662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1967b36-9e79-456b-bfab-0c3302892890 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5310190e53a14addb9b08513e7fb3857, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:37.320050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1967b36-9e79-456b-bfab-0c3302892890 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:37.330403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 117/239] 10.222.0.25 () {58 vars in 1334 bytes} [Sun Oct 23 01:58:37 2022] PUT /identity/v3/system/users/5310190e53a14addb9b08513e7fb3857/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:38.842303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a6ca1-23d6-48f3-9d8e-a729d3ed74d6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:38.843371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a6ca1-23d6-48f3-9d8e-a729d3ed74d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:38.843371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a6ca1-23d6-48f3-9d8e-a729d3ed74d6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:38.844749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 123/240] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:38.849926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa225-9ad3-4dda-9a1f-b0e3ce689c21 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:38.850573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa225-9ad3-4dda-9a1f-b0e3ce689c21 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:38.850736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa225-9ad3-4dda-9a1f-b0e3ce689c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:38.869770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c5fa225-9ad3-4dda-9a1f-b0e3ce689c21 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:38.870957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c5fa225-9ad3-4dda-9a1f-b0e3ce689c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:38.937798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 118/241] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:39.177398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7c86-35ce-4642-9f90-95c55e5653af None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.177702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7c86-35ce-4642-9f90-95c55e5653af None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.177959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7c86-35ce-4642-9f90-95c55e5653af None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.179433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 124/242] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:39.185747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11a58-8aa2-4fe9-8973-621a86edae3d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.186037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11a58-8aa2-4fe9-8973-621a86edae3d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.186877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11a58-8aa2-4fe9-8973-621a86edae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.203068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7c86-35ce-4642-9f90-95c55e5653af None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:39.204766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e2b11a58-8aa2-4fe9-8973-621a86edae3d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:39.206196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e2b11a58-8aa2-4fe9-8973-621a86edae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:39.215851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:39.280052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 119/243] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:39.326228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7c86-35ce-4642-9f90-95c55e5653af None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:39.363949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0db8-7031-4353-8858-982e2f1df652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:39.364612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0db8-7031-4353-8858-982e2f1df652 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.364892 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0db8-7031-4353-8858-982e2f1df652 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.365196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0db8-7031-4353-8858-982e2f1df652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.366376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0db8-7031-4353-8858-982e2f1df652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:39.367938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0db8-7031-4353-8858-982e2f1df652 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:39.369822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 125/244] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:39.375802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11a58-8aa2-4fe9-8973-621a86edae3d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:39.432649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:39.461735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74173c90-bf3a-476e-a974-aac1ad3eff04 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.462136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74173c90-bf3a-476e-a974-aac1ad3eff04 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.462480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74173c90-bf3a-476e-a974-aac1ad3eff04 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.463925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 126/245] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:58:39.470085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6b795-5bc2-4089-b34b-1bc9c468f84a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.470255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6b795-5bc2-4089-b34b-1bc9c468f84a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.470525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6b795-5bc2-4089-b34b-1bc9c468f84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.481852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11a58-8aa2-4fe9-8973-621a86edae3d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:39.489458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1aa6b795-5bc2-4089-b34b-1bc9c468f84a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:39.490741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1aa6b795-5bc2-4089-b34b-1bc9c468f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:39.517662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:39.518283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.518565 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.518838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] PATH_INFO: `/v3/groups` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.519465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:39.520906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:39.538452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 120/246] 10.222.0.25 () {60 vars in 1134 bytes} [Sun Oct 23 01:58:39 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:39.551401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:39.568644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 127/247] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:39.670206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d751937-6170-4777-b3c4-58b76c0d05ae None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:39.688592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:39.709273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:39.709919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.710200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.710494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.722847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:39.728504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:39.729442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:39.730221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 121/248] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:58:39.736183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6b795-5bc2-4089-b34b-1bc9c468f84a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:39.745446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:39.844584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6b795-5bc2-4089-b34b-1bc9c468f84a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:39.845245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:39.883229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:39.883839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:39.884114 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:39.884380 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:39.885080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:39.885381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:39.886774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:39.896948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 128/249] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:39.902358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:39.978317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1a97-053f-4a15-bf82-128c8902288c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:39.989587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:40.028122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:40.028349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:40.028614 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:40.028882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:40.034273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8eddd-452b-4e95-b0d4-81ebb1121d43 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:40.041369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:40.047370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:40.048318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:40.049151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 122/250] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:58:40.054224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:40.079976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:40.081165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:40.081593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:40.082011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] PATH_INFO: `/v3/users/6d71629aa8fc4168aae2c8cbf37701bb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:40.083457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] RBAC: Authorizing `identity:get_user(user_id=6d71629aa8fc4168aae2c8cbf37701bb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:40.086024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:40.088588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 129/251] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:39 2022] GET /identity/v3/users/6d71629aa8fc4168aae2c8cbf37701bb => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:40.094752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:40.101334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:40.200075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbe97b-8df5-43d8-817a-e104009029da None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:40.222642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2185-54c7-4276-99f2-6e6f65ee483b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:40.244461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:40.245714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:40.246204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:40.246795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:40.247763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:40.248320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:40.250725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:40.260129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:40.260925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:40.261254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:40.261527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] PATH_INFO: `/v3/system/users/6d71629aa8fc4168aae2c8cbf37701bb/roles/81523fd66bf54f7ba691134a68d0a256` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:40.263191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 123/252] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:40.265292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6d71629aa8fc4168aae2c8cbf37701bb, role_id=81523fd66bf54f7ba691134a68d0a256)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:40.267102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:40.270048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:40.271089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:40.283261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 130/253] 10.222.0.25 () {58 vars in 1334 bytes} [Sun Oct 23 01:58:40 2022] PUT /identity/v3/system/users/6d71629aa8fc4168aae2c8cbf37701bb/roles/81523fd66bf54f7ba691134a68d0a256 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:58:40.396000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864ae45-eb21-4af3-9dc1-6a9545d766c1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:40.397701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:40.433359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa927f-5859-4783-b355-98fad21bcdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:40.434016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa927f-5859-4783-b355-98fad21bcdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:40.434297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa927f-5859-4783-b355-98fad21bcdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:40.434571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa927f-5859-4783-b355-98fad21bcdf3 None admin] PATH_INFO: `/v3/users/5310190e53a14addb9b08513e7fb3857` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:40.435751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa927f-5859-4783-b355-98fad21bcdf3 None admin] RBAC: Authorizing `identity:get_user(user_id=5310190e53a14addb9b08513e7fb3857)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:40.437779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa927f-5859-4783-b355-98fad21bcdf3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:40.439776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 124/254] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:40 2022] GET /identity/v3/users/5310190e53a14addb9b08513e7fb3857 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:40.445483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:40.565476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585df10a-76cc-47fe-aa23-6c4060ff5f75 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:40.603333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6bda0-3bd4-4f2c-b103-3151538c0ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:40.603953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6bda0-3bd4-4f2c-b103-3151538c0ecb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:40.604292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6bda0-3bd4-4f2c-b103-3151538c0ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:40.604563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6bda0-3bd4-4f2c-b103-3151538c0ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:40.605368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6bda0-3bd4-4f2c-b103-3151538c0ecb None admin] RBAC: Adding query filter params (role.id=ebb01267d6294a78b508f59cff01b63b, user.id=5310190e53a14addb9b08513e7fb3857, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:40.605675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6bda0-3bd4-4f2c-b103-3151538c0ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:40.607105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6bda0-3bd4-4f2c-b103-3151538c0ecb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:40.620022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 131/255] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Oct 23 01:58:40 2022] GET /identity/v3/role_assignments?user.id=5310190e53a14addb9b08513e7fb3857&scope.system=all&role.id=ebb01267d6294a78b508f59cff01b63b => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:42.024753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6188006-045c-4f9a-a5ac-29f7e39779fd None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.025315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6188006-045c-4f9a-a5ac-29f7e39779fd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.025315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6188006-045c-4f9a-a5ac-29f7e39779fd None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.026907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 125/256] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:42.032416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d233-2163-4cbf-9fba-db4d4de776cf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.032823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d233-2163-4cbf-9fba-db4d4de776cf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.033051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d233-2163-4cbf-9fba-db4d4de776cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.058018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5475d233-2163-4cbf-9fba-db4d4de776cf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:42.059249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5475d233-2163-4cbf-9fba-db4d4de776cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:42.146654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 132/257] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 01:58:42.419909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da632b-cea5-4eae-ba09-68a85d7db945 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.420259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da632b-cea5-4eae-ba09-68a85d7db945 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.420968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da632b-cea5-4eae-ba09-68a85d7db945 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.422551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 126/258] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:42.427431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc524-b1b2-4507-970e-576d9fb28a44 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.427723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc524-b1b2-4507-970e-576d9fb28a44 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.427999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc524-b1b2-4507-970e-576d9fb28a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.441426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:42.453113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-087cc524-b1b2-4507-970e-576d9fb28a44 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:42.454574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-087cc524-b1b2-4507-970e-576d9fb28a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:42.468948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 133/259] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 01:58:42.664932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da632b-cea5-4eae-ba09-68a85d7db945 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:42.679401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da632b-cea5-4eae-ba09-68a85d7db945 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:42.685849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:42.687282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.687767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.688255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.705525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:42.710766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:42.711643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:42.712477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:42.714771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 127/260] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Oct 23 01:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:42.721291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc524-b1b2-4507-970e-576d9fb28a44 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:42.736899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc524-b1b2-4507-970e-576d9fb28a44 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:42.749623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:42.750371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.750748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.751135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.751913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:42.752315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:42.754150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:58:42.754150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 01:58:42.754150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 01:58:42.755063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:42.764510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 134/261] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:58:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:42.769755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:42.786251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c7297-2799-45f0-94bf-f0d206c55f79 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:42.794869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:42.795850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.796343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.796815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.807153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:42.809221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:58:42.809221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 01:58:42.809221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 01:58:42.810839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:42.813581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 128/262] 10.222.0.25 () {56 vars in 1201 bytes} [Sun Oct 23 01:58:42 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:42.818814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:42.830340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759901fe-4ed3-4471-bebb-3eeb7a595dbe admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:42.841116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:42.841775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.842057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.842368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.845695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:42.847810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:42.849482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 135/263] 10.222.0.25 () {56 vars in 1207 bytes} [Sun Oct 23 01:58:42 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:42.855372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:42.868165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4302-affb-4747-a424-d83633356b52 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:42.875411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:42.876350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.876842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:42.877347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4/groups/0a49b89927dd4ba489dafd644e76fb03/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:42.882208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7084cc89abc448658c55aaca1e3c30e4, group_id=0a49b89927dd4ba489dafd644e76fb03, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:42.883482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:58:42.883482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 01:58:42.883482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 01:58:42.885845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:42.896784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:42.910948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e7d96-a15a-4e30-8123-b4d5f485e66c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:42.914582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 129/264] 10.222.0.25 () {58 vars in 1463 bytes} [Sun Oct 23 01:58:42 2022] PUT /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4/groups/0a49b89927dd4ba489dafd644e76fb03/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:42.998908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:42.999570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:42.999843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.000113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.017825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:43.023284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:43.024148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:43.024959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 136/265] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Oct 23 01:58:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:58:43.030295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:43.047968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718e209-6558-4e51-b4dc-fd74e8bc9d87 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:43.059656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:43.060816 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.061423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.061918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.062817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:43.063319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:43.064557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:58:43.064557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 01:58:43.064557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 01:58:43.065865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:43.084192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 130/266] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Oct 23 01:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:43.089871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:43.102872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253964-3a5c-4586-a644-dea75eff6abb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:43.115442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:43.115442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.115442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.115442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.117668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:43.118706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:58:43.118706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 01:58:43.118706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 01:58:43.119924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:43.121560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 137/267] 10.222.0.25 () {56 vars in 1201 bytes} [Sun Oct 23 01:58:43 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:43.127296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:43.142953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf38c6-ed41-4505-ac00-1aa67163e4d2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:43.153190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb08bc-50c9-4f3d-b06d-ece169e45d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:43.154176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb08bc-50c9-4f3d-b06d-ece169e45d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.154697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb08bc-50c9-4f3d-b06d-ece169e45d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.155205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb08bc-50c9-4f3d-b06d-ece169e45d18 admin admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.161370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb08bc-50c9-4f3d-b06d-ece169e45d18 admin admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:43.163748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb08bc-50c9-4f3d-b06d-ece169e45d18 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:43.166087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 131/268] 10.222.0.25 () {56 vars in 1207 bytes} [Sun Oct 23 01:58:43 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:43.172007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:43.192569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364531be-d94d-430b-92ec-b72239d29b25 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:43.202264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929846e-450f-4d78-be23-97d702ed84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:43.202967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929846e-450f-4d78-be23-97d702ed84ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.203250 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929846e-450f-4d78-be23-97d702ed84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.203525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929846e-450f-4d78-be23-97d702ed84ac admin admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4/groups/0a49b89927dd4ba489dafd644e76fb03/roles/04c3574945c544d08b9e6b4c7ad69561` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.211349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929846e-450f-4d78-be23-97d702ed84ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7084cc89abc448658c55aaca1e3c30e4, group_id=0a49b89927dd4ba489dafd644e76fb03, role_id=04c3574945c544d08b9e6b4c7ad69561)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:43.212396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-4929846e-450f-4d78-be23-97d702ed84ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:58:43.212396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 01:58:43.212396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 01:58:43.214421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929846e-450f-4d78-be23-97d702ed84ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:43.243479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 138/269] 10.222.0.25 () {58 vars in 1463 bytes} [Sun Oct 23 01:58:43 2022] PUT /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4/groups/0a49b89927dd4ba489dafd644e76fb03/roles/04c3574945c544d08b9e6b4c7ad69561 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:43.417887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691798b3-9526-4bdf-8e2b-04044d34a776 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.418074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691798b3-9526-4bdf-8e2b-04044d34a776 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.418338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691798b3-9526-4bdf-8e2b-04044d34a776 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.419955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 132/270] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:43.426261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00b6d-b6ef-447f-8fa7-445ceaf128ca None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.426571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00b6d-b6ef-447f-8fa7-445ceaf128ca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.426818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00b6d-b6ef-447f-8fa7-445ceaf128ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.452181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-88f00b6d-b6ef-447f-8fa7-445ceaf128ca None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:43.453490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-88f00b6d-b6ef-447f-8fa7-445ceaf128ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:43.464753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de7ee8-2fb2-4216-87f3-df5439f126b9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.465093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de7ee8-2fb2-4216-87f3-df5439f126b9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.465340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de7ee8-2fb2-4216-87f3-df5439f126b9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.466926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 133/271] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:43.472748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecee229-fc41-4a97-ad66-d95ca66e303f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:43.473197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecee229-fc41-4a97-ad66-d95ca66e303f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:43.473393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecee229-fc41-4a97-ad66-d95ca66e303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:43.497367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7ecee229-fc41-4a97-ad66-d95ca66e303f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:43.499122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7ecee229-fc41-4a97-ad66-d95ca66e303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:43.566898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 139/272] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:43.606220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 134/273] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 01:58:43.975869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00b6d-b6ef-447f-8fa7-445ceaf128ca None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.020450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:44.088406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00b6d-b6ef-447f-8fa7-445ceaf128ca None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.132098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.132926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.133094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.133294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.156276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:44.161264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:44.162171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:44.162963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 140/274] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:44.168318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecee229-fc41-4a97-ad66-d95ca66e303f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.178923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.199880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb21a3-7b85-4248-acf8-4620e1968396 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.212883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.216083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.216371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.216647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.240121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:44.245090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:44.247136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:44.249673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 141/275] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Oct 23 01:58:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:44.252672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.267363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f18a-8dd6-4f01-b124-8514e38dbb4c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.286576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.287200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.287484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.287764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.288446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:44.288755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:44.290451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:44.304163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 142/276] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:58:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:44.312091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.321598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:44.340036 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905645c7-fbc2-4817-b87e-194c214dc6e1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.356450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.357188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.357464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.358344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.361181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:44.366778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:44.369941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 143/277] 10.222.0.25 () {56 vars in 1201 bytes} [Sun Oct 23 01:58:44 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:44.378011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.391724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0841efa-dbe5-412f-951d-e42f9632ee17 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.396829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.397677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.398122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.398532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.405784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:44.408150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:44.410126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 144/278] 10.222.0.25 () {56 vars in 1207 bytes} [Sun Oct 23 01:58:44 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:44.413972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecee229-fc41-4a97-ad66-d95ca66e303f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.419286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.434513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f91fd3-8fcb-4fdb-9250-b211ca1c65b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.440950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.441878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.442295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.442702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/groups/0a49b89927dd4ba489dafd644e76fb03/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.450373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cd6fc119584a5b9eb97fe528335ca1, group_id=0a49b89927dd4ba489dafd644e76fb03, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:44.454006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:44.476575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 145/279] 10.222.0.25 () {58 vars in 1463 bytes} [Sun Oct 23 01:58:44 2022] PUT /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/groups/0a49b89927dd4ba489dafd644e76fb03/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:58:44.495007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6f37-5ada-4c08-8cc8-67395a56aec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.495569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6f37-5ada-4c08-8cc8-67395a56aec0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.495852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6f37-5ada-4c08-8cc8-67395a56aec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.496126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6f37-5ada-4c08-8cc8-67395a56aec0 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.496812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b6f37-5ada-4c08-8cc8-67395a56aec0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:44.497150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b6f37-5ada-4c08-8cc8-67395a56aec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:44.498619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b6f37-5ada-4c08-8cc8-67395a56aec0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:44.515899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 135/280] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:44.521703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.549045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72114b3-84a0-4df1-bec2-2159b23863a6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.549045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72114b3-84a0-4df1-bec2-2159b23863a6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.549045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72114b3-84a0-4df1-bec2-2159b23863a6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.549731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 136/281] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:44.574856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f51a4-5cb0-417d-a458-15e0650af764 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.575130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f51a4-5cb0-417d-a458-15e0650af764 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.575407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f51a4-5cb0-417d-a458-15e0650af764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.612990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:44.617681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b98f51a4-5cb0-417d-a458-15e0650af764 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:44.618930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b98f51a4-5cb0-417d-a458-15e0650af764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:44.697683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652bec-92c6-4e45-9a43-a9890aa2b970 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.754494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 137/282] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 23 01:58:44.755526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.756246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.756529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.756810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] PATH_INFO: `/v3/users/6d71629aa8fc4168aae2c8cbf37701bb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.759124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] RBAC: Authorizing `identity:get_user(user_id=6d71629aa8fc4168aae2c8cbf37701bb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:44.760723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:44.762636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 146/283] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:58:44 2022] GET /identity/v3/users/6d71629aa8fc4168aae2c8cbf37701bb => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:44.768783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f51a4-5cb0-417d-a458-15e0650af764 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:44.884120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:44.918054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f51a4-5cb0-417d-a458-15e0650af764 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:44.964478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107050-2565-4caf-aff0-bfd63894d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:44.965120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107050-2565-4caf-aff0-bfd63894d7ea None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:44.965403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107050-2565-4caf-aff0-bfd63894d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:44.965675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107050-2565-4caf-aff0-bfd63894d7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:44.966412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107050-2565-4caf-aff0-bfd63894d7ea None admin] RBAC: Adding query filter params (role.id=81523fd66bf54f7ba691134a68d0a256, user.id=6d71629aa8fc4168aae2c8cbf37701bb, scope.system=all) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:44.966721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107050-2565-4caf-aff0-bfd63894d7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:44.968426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107050-2565-4caf-aff0-bfd63894d7ea None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:44.985854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 138/284] 10.222.0.25 () {56 vars in 1308 bytes} [Sun Oct 23 01:58:44 2022] GET /identity/v3/role_assignments?user.id=6d71629aa8fc4168aae2c8cbf37701bb&scope.system=all&role.id=81523fd66bf54f7ba691134a68d0a256 => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:45.164507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.182318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0306ebb-555d-4552-ada3-fa8df5addd6d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.187693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.188389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.188667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.189037 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.190629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230209-da53-467d-9158-99e51acb2d98 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.191069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230209-da53-467d-9158-99e51acb2d98 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.191232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230209-da53-467d-9158-99e51acb2d98 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.192546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 139/285] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:45.198154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643e360-3216-480e-9a59-8b2b8714cc52 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.198439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643e360-3216-480e-9a59-8b2b8714cc52 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.198718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643e360-3216-480e-9a59-8b2b8714cc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.207814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:45.213020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:45.213967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:45.214751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:45.219158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 147/286] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:45.220559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.230451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e643e360-3216-480e-9a59-8b2b8714cc52 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:45.231247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9de2d-daa8-495f-a2f8-0804c0061325 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.231691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e643e360-3216-480e-9a59-8b2b8714cc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:45.242528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.243263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.243542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.243810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.244547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:45.244850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.246722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.256242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 140/287] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 23 01:58:45.267120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 148/288] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:45.272870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643e360-3216-480e-9a59-8b2b8714cc52 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.287923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643e360-3216-480e-9a59-8b2b8714cc52 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.302542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.303194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.303475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.303751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.309650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.311675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.313652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 141/289] 10.222.0.25 () {56 vars in 1201 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:45.318963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.331650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5002b57-4e0c-4e5b-9132-d7af951e6ba4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.339846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.340478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.340752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.341056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.343480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.345569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.348227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 149/290] 10.222.0.25 () {56 vars in 1207 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:45.353518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.364258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c569a5-6650-48b5-836a-ae6014690faf admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.371247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.371854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.372185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.372459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/groups/0a49b89927dd4ba489dafd644e76fb03/roles/04c3574945c544d08b9e6b4c7ad69561` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.375355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cd6fc119584a5b9eb97fe528335ca1, group_id=0a49b89927dd4ba489dafd644e76fb03, role_id=04c3574945c544d08b9e6b4c7ad69561)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.378214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.399740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 142/291] 10.222.0.25 () {58 vars in 1463 bytes} [Sun Oct 23 01:58:45 2022] PUT /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1/groups/0a49b89927dd4ba489dafd644e76fb03/roles/04c3574945c544d08b9e6b4c7ad69561 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:45.593421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.606134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207420-9dc8-4efa-8dd1-3e20fbe085c7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.689552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.690101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.690375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.690644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.702729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:45.707720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:45.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:45.712717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 150/292] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:45.718754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.732130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803c75f-246b-4a65-858a-64098b3e87ac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.741586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.742195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.742468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.742735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.743449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:45.743755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.745505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.754362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 143/293] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:45.760738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.774109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20e6b-cb02-4e35-bb67-8f4431b42053 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.778503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.779135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.779415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.780263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] PATH_INFO: `/v3/groups/4ed31906dfb546689b534b64c26d0c31` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.794474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] RBAC: Authorizing `identity:get_group(group_id=4ed31906dfb546689b534b64c26d0c31)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.796515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.798521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 151/294] 10.222.0.25 () {56 vars in 1201 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/groups/4ed31906dfb546689b534b64c26d0c31 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:45.804086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.818833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcae813-97df-49af-b57c-53797f3b9ee6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.825605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7555cb-e121-4636-a77d-cb928c3e7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.827145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7555cb-e121-4636-a77d-cb928c3e7faf admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.827631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7555cb-e121-4636-a77d-cb928c3e7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.828069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7555cb-e121-4636-a77d-cb928c3e7faf admin admin] PATH_INFO: `/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.830799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7555cb-e121-4636-a77d-cb928c3e7faf admin admin] RBAC: Authorizing `identity:get_project(project_id=6f5af6c6d2bb4361a1d4b7374821b416)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.832817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7555cb-e121-4636-a77d-cb928c3e7faf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.834780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 144/295] 10.222.0.25 () {56 vars in 1207 bytes} [Sun Oct 23 01:58:45 2022] GET /identity/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:45.841108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:45.854639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b903-a094-456e-82b1-5f4a24816d69 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:45.864897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefbb9d-fe70-47c8-8a92-a169bad91e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:45.865620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefbb9d-fe70-47c8-8a92-a169bad91e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:45.865898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefbb9d-fe70-47c8-8a92-a169bad91e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:45.866170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefbb9d-fe70-47c8-8a92-a169bad91e65 admin admin] PATH_INFO: `/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416/groups/4ed31906dfb546689b534b64c26d0c31/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:45.868072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefbb9d-fe70-47c8-8a92-a169bad91e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5af6c6d2bb4361a1d4b7374821b416, group_id=4ed31906dfb546689b534b64c26d0c31, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:45.870774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefbb9d-fe70-47c8-8a92-a169bad91e65 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:45.887848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 152/296] 10.222.0.25 () {58 vars in 1463 bytes} [Sun Oct 23 01:58:45 2022] PUT /identity/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416/groups/4ed31906dfb546689b534b64c26d0c31/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:46.202623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4aeb-babe-4e0a-8608-b24f52f8e13f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:46.203465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4aeb-babe-4e0a-8608-b24f52f8e13f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:46.203740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e4aeb-babe-4e0a-8608-b24f52f8e13f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:46.205279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 145/297] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:46.210538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237549-c80f-4bd3-b45d-b812bd5508c7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:46.211395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237549-c80f-4bd3-b45d-b812bd5508c7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:46.211863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237549-c80f-4bd3-b45d-b812bd5508c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:46.232061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3e237549-c80f-4bd3-b45d-b812bd5508c7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:46.233757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3e237549-c80f-4bd3-b45d-b812bd5508c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:46.250425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:46.327316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 153/298] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:46.572221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850f29-c57e-4154-9529-14fce2a5c08c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:46.572902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850f29-c57e-4154-9529-14fce2a5c08c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:46.573408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850f29-c57e-4154-9529-14fce2a5c08c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:46.575208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 146/299] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:46.581377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbfdcc-8925-44ed-bab7-448dcb4c3c64 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:46.581663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbfdcc-8925-44ed-bab7-448dcb4c3c64 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:46.581938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbfdcc-8925-44ed-bab7-448dcb4c3c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:46.604647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b9dbfdcc-8925-44ed-bab7-448dcb4c3c64 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:46.605846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b9dbfdcc-8925-44ed-bab7-448dcb4c3c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:46.678439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 154/300] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:46.781579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850f29-c57e-4154-9529-14fce2a5c08c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:46.883156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:46.890275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850f29-c57e-4154-9529-14fce2a5c08c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:46.929140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:46.929831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:46.930112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:46.930430 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:46.941613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:46.946552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:46.947432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:46.948220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 147/301] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:46.953945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbfdcc-8925-44ed-bab7-448dcb4c3c64 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:47.038038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:47.068647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbfdcc-8925-44ed-bab7-448dcb4c3c64 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:47.126813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:47.127438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:47.127724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:47.127996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:47.128670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:47.129004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:47.130378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:47.139585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 155/302] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:47.150099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:47.162072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:47.320955 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520f352-8360-4a35-bf7e-b7c20c26570c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:47.348526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd34d2-b421-4f8f-92a8-604e040a8157 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:47.393294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:47.393860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:47.394140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:47.394411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:47.412477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:47.416836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:47.425423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:47.426310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:47.427971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 156/303] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:58:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:47.429546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:47.429546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:47.429546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:47.429546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:47.438220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:47.485658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:47.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:47.536705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:47.644190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 148/304] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:47.649661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:47.656219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac4ba7-38b8-4620-b23a-069db6177d8e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:47.711590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:47.753703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:47.754614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:47.754896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:47.755170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:47.755848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:47.756148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:47.756680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27812-25a7-4617-85b4-7c57ff8f3605 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:47.757569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:47.783235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 157/305] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:58:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:47.791824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:47.794015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:47.794834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:47.795323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:47.795749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:47.797536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:47.799119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:47.801214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 149/306] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:47 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:47.807677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:47.915959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dbea0-9624-49d6-9567-d5a9e6ccb480 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:47.930274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:47.947935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:47.953932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:47.954855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:47.955389 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:47.955855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:47.961825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:47.963515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:47.965374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 150/307] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Oct 23 01:58:47 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:47.971548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:48.012038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d7d4-477d-4282-946b-ab93f751a4a3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:48.083712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcad2c3-575d-445a-9c7a-d7a6d1fd1a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:48.086344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad2c3-575d-445a-9c7a-d7a6d1fd1a90 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.087852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad2c3-575d-445a-9c7a-d7a6d1fd1a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.088340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad2c3-575d-445a-9c7a-d7a6d1fd1a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.177150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77330b8f-8c1a-44ec-88db-26aa4d5689ef None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:48.230846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcad2c3-575d-445a-9c7a-d7a6d1fd1a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:48.232402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcad2c3-575d-445a-9c7a-d7a6d1fd1a90 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:48.242249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28682c3-eff0-40af-ae69-e94280f565c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:48.242888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28682c3-eff0-40af-ae69-e94280f565c4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.243170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28682c3-eff0-40af-ae69-e94280f565c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.243440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28682c3-eff0-40af-ae69-e94280f565c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.244270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28682c3-eff0-40af-ae69-e94280f565c4 None admin] RBAC: Adding query filter params (group.id=0a49b89927dd4ba489dafd644e76fb03, role.id=ebb01267d6294a78b508f59cff01b63b, scope.project.id=7084cc89abc448658c55aaca1e3c30e4) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:48.244579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28682c3-eff0-40af-ae69-e94280f565c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:48.246182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28682c3-eff0-40af-ae69-e94280f565c4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:48.256718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 151/308] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Oct 23 01:58:47 2022] GET /identity/v3/role_assignments?group.id=0a49b89927dd4ba489dafd644e76fb03&scope.project.id=7084cc89abc448658c55aaca1e3c30e4&role.id=ebb01267d6294a78b508f59cff01b63b => generated 611 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:48.258193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6eb5d-cee0-4867-92e7-6199117917a7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.258481 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6eb5d-cee0-4867-92e7-6199117917a7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.258753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6eb5d-cee0-4867-92e7-6199117917a7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.260106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 152/309] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:48.268772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902eb56-6f2c-4d1a-858c-742f722131ec None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.269088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902eb56-6f2c-4d1a-858c-742f722131ec None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.269364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902eb56-6f2c-4d1a-858c-742f722131ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.297042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4902eb56-6f2c-4d1a-858c-742f722131ec None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:48.300286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4902eb56-6f2c-4d1a-858c-742f722131ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:48.322643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:48.395579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:48.405718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 158/310] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 01:58:48.407136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791105-ac5f-467f-82b2-fd355bc08635 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.407415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791105-ac5f-467f-82b2-fd355bc08635 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.407687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791105-ac5f-467f-82b2-fd355bc08635 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.410339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 159/311] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:48.413535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13791105-ac5f-467f-82b2-fd355bc08635 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:48.433095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 153/312] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:48.433095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559f75a-569b-4a9e-9a32-328b302a7575 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.433095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559f75a-569b-4a9e-9a32-328b302a7575 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.433095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559f75a-569b-4a9e-9a32-328b302a7575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.452788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3559f75a-569b-4a9e-9a32-328b302a7575 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:48.456164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3559f75a-569b-4a9e-9a32-328b302a7575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:48.565720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 154/313] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:48.586764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13791105-ac5f-467f-82b2-fd355bc08635 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:48.631933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9f67-dcd4-4582-8e0a-6a8362a1bd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:48.632586 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9f67-dcd4-4582-8e0a-6a8362a1bd4b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.632920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9f67-dcd4-4582-8e0a-6a8362a1bd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.633304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9f67-dcd4-4582-8e0a-6a8362a1bd4b None admin] PATH_INFO: `/v3/projects/7084cc89abc448658c55aaca1e3c30e4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.637706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9f67-dcd4-4582-8e0a-6a8362a1bd4b None admin] RBAC: Authorizing `identity:get_project(project_id=7084cc89abc448658c55aaca1e3c30e4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:48.639758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9f67-dcd4-4582-8e0a-6a8362a1bd4b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:48.641491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 160/314] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:48 2022] GET /identity/v3/projects/7084cc89abc448658c55aaca1e3c30e4 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:48.647908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559f75a-569b-4a9e-9a32-328b302a7575 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:48.768083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50abe5d-80d3-4007-9aa5-711974e12674 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.768450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50abe5d-80d3-4007-9aa5-711974e12674 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.768632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50abe5d-80d3-4007-9aa5-711974e12674 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.770127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 161/315] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:58:48.776989 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7a89-4215-4761-b9bd-1a7ce4ffec90 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.777284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7a89-4215-4761-b9bd-1a7ce4ffec90 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.777601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7a89-4215-4761-b9bd-1a7ce4ffec90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.783183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559f75a-569b-4a9e-9a32-328b302a7575 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:48.801272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:48.801946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-748d7a89-4215-4761-b9bd-1a7ce4ffec90 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:48.803472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-748d7a89-4215-4761-b9bd-1a7ce4ffec90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:48.825324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:48.826946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:48.827235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:48.827792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:48.829110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:48.830224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:48.830906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:48.833913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 155/316] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Oct 23 01:58:48 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:48.839420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:48.883301 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 162/317] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:48.884152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d7a89-4215-4761-b9bd-1a7ce4ffec90 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:48.970910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e721-a38c-4465-aa48-157a28c4fa32 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.006365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d7a89-4215-4761-b9bd-1a7ce4ffec90 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.018896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.019776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.020058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.020485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.031911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:49.036793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:49.037762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:49.038561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 156/318] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:49.039219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.052763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.053404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.053681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.053950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.054668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] RBAC: Adding query filter params (group.id=0a49b89927dd4ba489dafd644e76fb03, role.id=04c3574945c544d08b9e6b4c7ad69561, scope.project.id=7084cc89abc448658c55aaca1e3c30e4) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:49.055353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:49.056393 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:49.062739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 163/319] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Oct 23 01:58:48 2022] GET /identity/v3/role_assignments?group.id=0a49b89927dd4ba489dafd644e76fb03&scope.project.id=7084cc89abc448658c55aaca1e3c30e4&role.id=04c3574945c544d08b9e6b4c7ad69561 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:49.063642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.101411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.102006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.195014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c42f60-59bd-4b30-a70b-bd9f73271b54 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.202552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471922dd-c581-4704-8f47-53b8671e361c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.238351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.239306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.239590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.239869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.253047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.253695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.254227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.254227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.254922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:49.255232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:49.256666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:49.259222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:49.264578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:49.265533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:49.266966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:49.267854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 164/320] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:49.267935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 157/321] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:49.268002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.272139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.375257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.391397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e0785-1cda-4784-8311-442d03349a84 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.401154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ecd7-c696-4c35-8af3-a5dc8fa5814f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.403999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.431366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.432045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.432318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.432598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.443791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.444054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:49.444401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.444676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.444942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:49.451399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:49.452302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:49.453227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 165/322] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:49.453892 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.536539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:49.537966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:49.568471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d43cc-dc35-4ad2-a6fc-4312bd4e0d61 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.610055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.610668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.610946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.611214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.611878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:49.612177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:49.613611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:49.621787 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 166/323] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:49.622698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.633886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.661168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 158/324] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:49.662050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.665704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.745867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240b532-4b3d-4e2a-a825-911aefe9dad7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.785692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5b95-eedd-46a2-a74c-04ecc48ff1f9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.789700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.790478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.790765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.791030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.791692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:49.791990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:49.793397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:49.803313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 167/325] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:49.804217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:49.827418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.828040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.828320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.828592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.888448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.912712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:49.914209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:49.917407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:49.927177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6dce0-691b-4cd1-8a5f-01638409253e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:49.966938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:49.967579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:49.967945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:49.968212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:49.969371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:49.970806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:49.972425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 168/326] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:49.973222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.019544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 159/327] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:50.020388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.075369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e8cb4-a26f-4621-bee2-ffcbf463eb14 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.112154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.112770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.113083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.113368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.115487 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd832b8-6ac0-465f-b8e4-3c0f6de28aa8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.118250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:50.122101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:50.151189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.151811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.152086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.152351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.153455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.155411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.156955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 160/328] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:50.157720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.188768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.190343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.257432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2d74a-6465-412f-b58b-5f60886f5201 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.286292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 169/329] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:58:50.287323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.290618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.291246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.291519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.291789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] PATH_INFO: `/v3/projects/52cd6fc119584a5b9eb97fe528335ca1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.292898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] RBAC: Authorizing `identity:get_project(project_id=52cd6fc119584a5b9eb97fe528335ca1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.294381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.295995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 161/330] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/projects/52cd6fc119584a5b9eb97fe528335ca1 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:50.296750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.330383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:50.340416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:50.387828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e8c1c-43dd-4aec-a3ab-7ac3608f571c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.398249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae700-d6b3-41e1-bfb1-6b9bed0df812 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.421014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.421609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.421879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.422150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.422859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] RBAC: Adding query filter params (group.id=0a49b89927dd4ba489dafd644e76fb03, role.id=ebb01267d6294a78b508f59cff01b63b, scope.project.id=52cd6fc119584a5b9eb97fe528335ca1) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:50.423155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.424570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.430112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 170/331] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/role_assignments?group.id=0a49b89927dd4ba489dafd644e76fb03&scope.project.id=52cd6fc119584a5b9eb97fe528335ca1&role.id=ebb01267d6294a78b508f59cff01b63b => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:50.430877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.443474 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.444236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.444516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.444790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] PATH_INFO: `/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.446147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] RBAC: Authorizing `identity:get_project(project_id=6f5af6c6d2bb4361a1d4b7374821b416)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.447637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.449429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 162/332] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/projects/6f5af6c6d2bb4361a1d4b7374821b416 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:50.455791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.545737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d090b0-69be-432b-9bfe-9286e5e47d77 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.547431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:50.573882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94cbd-b418-427c-8f63-073d1799a27e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.586274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:50.588366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.589051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.589440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.589616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] PATH_INFO: `/v3/groups/0a49b89927dd4ba489dafd644e76fb03` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.590842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] RBAC: Authorizing `identity:get_group(group_id=0a49b89927dd4ba489dafd644e76fb03)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.592440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.594026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 171/333] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/groups/0a49b89927dd4ba489dafd644e76fb03 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:50.600243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.620132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.620770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.621074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.621343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] PATH_INFO: `/v3/groups/4ed31906dfb546689b534b64c26d0c31` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.622438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] RBAC: Authorizing `identity:get_group(group_id=4ed31906dfb546689b534b64c26d0c31)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.623934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.631486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 163/334] 10.222.0.25 () {56 vars in 1180 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/groups/4ed31906dfb546689b534b64c26d0c31 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:50.632846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:50.716336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c96c-b193-4e2e-854e-1b0c6faeddd0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.747696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57737285-eba9-4af8-b301-8620c2ba4b59 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:50.760670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f6dd-475c-4d77-ad23-45a858998da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.761362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f6dd-475c-4d77-ad23-45a858998da7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.761639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f6dd-475c-4d77-ad23-45a858998da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.761906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f6dd-475c-4d77-ad23-45a858998da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.762637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f6dd-475c-4d77-ad23-45a858998da7 None admin] RBAC: Adding query filter params (group.id=0a49b89927dd4ba489dafd644e76fb03, role.id=04c3574945c544d08b9e6b4c7ad69561, scope.project.id=52cd6fc119584a5b9eb97fe528335ca1) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:50.762940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f6dd-475c-4d77-ad23-45a858998da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.764413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f6dd-475c-4d77-ad23-45a858998da7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.770397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 172/335] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/role_assignments?group.id=0a49b89927dd4ba489dafd644e76fb03&scope.project.id=52cd6fc119584a5b9eb97fe528335ca1&role.id=04c3574945c544d08b9e6b4c7ad69561 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:50.789180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568042ea-2d8e-40da-a54a-26ebf4a47f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:50.789819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568042ea-2d8e-40da-a54a-26ebf4a47f26 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:50.790101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568042ea-2d8e-40da-a54a-26ebf4a47f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:50.790526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568042ea-2d8e-40da-a54a-26ebf4a47f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:50.791286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568042ea-2d8e-40da-a54a-26ebf4a47f26 None admin] RBAC: Adding query filter params (group.id=4ed31906dfb546689b534b64c26d0c31, role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=6f5af6c6d2bb4361a1d4b7374821b416) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:50.791597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568042ea-2d8e-40da-a54a-26ebf4a47f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:50.793121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568042ea-2d8e-40da-a54a-26ebf4a47f26 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:50.801191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 164/336] 10.222.0.25 () {56 vars in 1376 bytes} [Sun Oct 23 01:58:50 2022] GET /identity/v3/role_assignments?group.id=4ed31906dfb546689b534b64c26d0c31&scope.project.id=6f5af6c6d2bb4361a1d4b7374821b416&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:53.441728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e444b-a453-47a4-8d39-3e3d03938f1c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:53.442734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e444b-a453-47a4-8d39-3e3d03938f1c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:53.443241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e444b-a453-47a4-8d39-3e3d03938f1c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:53.445062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 173/337] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:53.450706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3337176-c67a-47d2-b8a6-f731a39f20da None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:53.452071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3337176-c67a-47d2-b8a6-f731a39f20da None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:53.452543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3337176-c67a-47d2-b8a6-f731a39f20da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:53.475854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f3337176-c67a-47d2-b8a6-f731a39f20da None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:53.477431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f3337176-c67a-47d2-b8a6-f731a39f20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:53.530125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:53.573354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 165/338] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:53.911400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d9ea-bb5e-4938-92a6-91dd542237a1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:53.912091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d9ea-bb5e-4938-92a6-91dd542237a1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:53.912563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d9ea-bb5e-4938-92a6-91dd542237a1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:53.915004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 174/339] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:58:53.931636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a1a2-c205-45cc-aa60-490acffd2de7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:53.932182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a1a2-c205-45cc-aa60-490acffd2de7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:53.932465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a1a2-c205-45cc-aa60-490acffd2de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:53.933412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fef149-ed55-434c-8159-e1e778a4ce43 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:53.933910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fef149-ed55-434c-8159-e1e778a4ce43 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:53.934384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fef149-ed55-434c-8159-e1e778a4ce43 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:53.936437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 175/340] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:58:53.941830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345a3d-b4ca-48d0-8d34-8bf39c54246c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:53.943236 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345a3d-b4ca-48d0-8d34-8bf39c54246c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:53.943689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345a3d-b4ca-48d0-8d34-8bf39c54246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:53.953504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-73c7a1a2-c205-45cc-aa60-490acffd2de7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:53.954773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73c7a1a2-c205-45cc-aa60-490acffd2de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:53.963981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-87345a3d-b4ca-48d0-8d34-8bf39c54246c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:53.965797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-87345a3d-b4ca-48d0-8d34-8bf39c54246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:53.994765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:54.034401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 166/341] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:54.035603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a1a2-c205-45cc-aa60-490acffd2de7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.045835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 176/342] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:54.190375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:54.194346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a1a2-c205-45cc-aa60-490acffd2de7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:54.213953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c15c1-e093-42ab-9d7f-f8ded56fc120 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.214549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c15c1-e093-42ab-9d7f-f8ded56fc120 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.214827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c15c1-e093-42ab-9d7f-f8ded56fc120 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.216303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 177/343] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:54.223121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720823e-4e9f-4be9-a7b0-f94cacb958d3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.223635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720823e-4e9f-4be9-a7b0-f94cacb958d3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.224564 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720823e-4e9f-4be9-a7b0-f94cacb958d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.244646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:54.245303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.245580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.245847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.248764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5720823e-4e9f-4be9-a7b0-f94cacb958d3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:54.250434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5720823e-4e9f-4be9-a7b0-f94cacb958d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:54.266601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:54.268064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:54.291227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:54.292233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:54.293110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:54.293110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:54.293110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:54.293110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 167/344] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:54.298292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.334680 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 178/345] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:58:54.340995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720823e-4e9f-4be9-a7b0-f94cacb958d3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.417124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9517f-a192-4afd-9d47-d3bf8fdb7fbc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:54.457707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:54.458295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.458514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.458775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.459417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:54.459724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:54.462394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:54.487803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 168/346] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:54.488665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.502079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:54.510299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720823e-4e9f-4be9-a7b0-f94cacb958d3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:54.517295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:54.553585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:54.554222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.554501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.554770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.568434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:54.570436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:54.590980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:54.592483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:54.593411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:54.593411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:54.593411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:54.599108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 179/347] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:54.599108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.623641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636f142-3027-4dc8-b5a9-a40fd8eea41e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:54.665419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:54.666672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.667156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.667619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.680185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:54.682797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:54.702287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:54.703222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:54.704055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:54.704055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:54.704055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:54.705876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 169/348] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:54.705876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.707044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0607ef7-5f22-45cb-a335-4f6184f3807d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:54.745502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:54.746028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.746305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.746576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.747217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:54.748686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:54.771376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 180/349] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:54 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:54.772483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.775359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:54.782240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:54.828749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc905d-c51d-4072-83fc-bd9a9575ff0a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:54.868078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:54.868708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.869009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.869319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.869988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:54.870297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:54.871710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:54.885814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 170/350] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:54.885814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:54.920997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5ed53-7b21-46d8-b728-88b7384e68a0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:54.969168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:54.970192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:54.970668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:54.971165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:54.985105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:54.986547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:55.004891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6edcd8-b44c-4af6-8553-3917eb98cb4b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:55.005864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:55.006794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:55.007709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:55.007709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:55.007709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:55.007709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 181/351] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:55.007709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:55.038457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:55.054621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:55.055242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:55.055524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:55.055795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:55.056444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:55.057221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:55.058599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:55.072612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:55.074969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 171/352] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:55.075807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:55.148396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae58bb-7b31-4af3-b0b8-7edd63546391 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:55.193872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:55.194584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:55.194868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:55.195139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:55.195790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:55.197165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e79b-c239-4c58-9562-2133908ad205 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:55.197289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:55.227080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 182/353] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:55 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:55.229707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:55.239955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cade3c-45e6-4944-8049-7860eae508f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:55.240589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cade3c-45e6-4944-8049-7860eae508f3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:55.240873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cade3c-45e6-4944-8049-7860eae508f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:55.241204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cade3c-45e6-4944-8049-7860eae508f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:55.241872 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cade3c-45e6-4944-8049-7860eae508f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:55.242204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cade3c-45e6-4944-8049-7860eae508f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:55.243725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cade3c-45e6-4944-8049-7860eae508f3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:55.264672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 172/354] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:55.267050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7581e-4d66-4525-bd81-796729d6cf12 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:55.267344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7581e-4d66-4525-bd81-796729d6cf12 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:55.267621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7581e-4d66-4525-bd81-796729d6cf12 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:55.269252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 173/355] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:55.270036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7581e-4d66-4525-bd81-796729d6cf12 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:55.331951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:55.396002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bde-379a-48dc-84ca-7d0309a70bcc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:55.402731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7581e-4d66-4525-bd81-796729d6cf12 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:55.410847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:55.443405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8629f-0925-46e0-99d5-02999d1451f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:55.444325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8629f-0925-46e0-99d5-02999d1451f6 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:55.444325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8629f-0925-46e0-99d5-02999d1451f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:55.444595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8629f-0925-46e0-99d5-02999d1451f6 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:55.445236 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8629f-0925-46e0-99d5-02999d1451f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:55.446691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8629f-0925-46e0-99d5-02999d1451f6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:55.453683 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:55.454296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:55.454572 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:55.454838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:55.455474 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:55.456886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:55.475630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 183/356] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:55 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:55.476672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9aaa7-77f8-44d0-a35a-a0fb1ae60a2d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:55.476962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9aaa7-77f8-44d0-a35a-a0fb1ae60a2d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:55.478022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9aaa7-77f8-44d0-a35a-a0fb1ae60a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:55.485848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 174/357] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:58:55 2022] POST /identity/v3/users => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:55.516871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-28d9aaa7-77f8-44d0-a35a-a0fb1ae60a2d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:55.518095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-28d9aaa7-77f8-44d0-a35a-a0fb1ae60a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:55.630588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 184/358] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:55.960044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:56.063049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:56.070314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114745-b717-4f8b-9717-4f30cdab20e4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:56.106119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:56.106742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:56.107020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:56.107356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:56.108041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:56.109526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:56.125659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.sql.core [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 01:58:56.125659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 01:58:56.125659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [parameters: {'id': 'a6a4cb9046c64097bf218217e7314f12', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 01:58:56.125659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:58:56.132964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return ref.to_dict() Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:58:56.133831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application yield resource Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise self.value Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application session.commit() Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:58:56.134921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:58:56.136397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:58:56.137912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:58:56.139983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [parameters: {'id': 'a6a4cb9046c64097bf218217e7314f12', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:56.141912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 01:58:56.145310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:56.154880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 175/359] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Oct 23 01:58:55 2022] POST /identity/v3/roles => generated 144 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:56.155020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9aaa7-77f8-44d0-a35a-a0fb1ae60a2d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:56.278443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:56.285610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9aaa7-77f8-44d0-a35a-a0fb1ae60a2d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:56.328438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d19f74-5945-4ef3-ab86-ac4b3ffb9d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:56.329111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19f74-5945-4ef3-ab86-ac4b3ffb9d60 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:56.329388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19f74-5945-4ef3-ab86-ac4b3ffb9d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:56.329663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19f74-5945-4ef3-ab86-ac4b3ffb9d60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:56.339889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d19f74-5945-4ef3-ab86-ac4b3ffb9d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-12d19f74-5945-4ef3-ab86-ac4b3ffb9d60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:56.344862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:56.345815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:56.347034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 185/360] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:58:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:56.352326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:56.496923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773e7a-76cc-4445-88a8-101d8bb64deb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:56.543127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d282fa2-0e40-4b77-b6c4-d26a9328cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:56.543665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d282fa2-0e40-4b77-b6c4-d26a9328cb9a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:56.543947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d282fa2-0e40-4b77-b6c4-d26a9328cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:56.544223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d282fa2-0e40-4b77-b6c4-d26a9328cb9a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:56.545449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d282fa2-0e40-4b77-b6c4-d26a9328cb9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:56.545755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d282fa2-0e40-4b77-b6c4-d26a9328cb9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:56.547181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d282fa2-0e40-4b77-b6c4-d26a9328cb9a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:56.560710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 176/361] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:58:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:57.531268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ab49-6c10-4e20-8d0d-74e0c05e5a6e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:57.531779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ab49-6c10-4e20-8d0d-74e0c05e5a6e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:57.531877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ab49-6c10-4e20-8d0d-74e0c05e5a6e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:57.533411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 186/362] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:57.538993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aea11-7fb7-4cf6-9846-e0ea1be40973 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:57.539819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aea11-7fb7-4cf6-9846-e0ea1be40973 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:57.540284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aea11-7fb7-4cf6-9846-e0ea1be40973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:57.562451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-360aea11-7fb7-4cf6-9846-e0ea1be40973 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:57.563933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-360aea11-7fb7-4cf6-9846-e0ea1be40973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:57.588226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:57.648244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 177/363] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:57.799018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9c3a-b298-4b80-9330-3219d9b9cda5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:57.799196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9c3a-b298-4b80-9330-3219d9b9cda5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:57.799469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9c3a-b298-4b80-9330-3219d9b9cda5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:57.801631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 187/364] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:57.807076 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624778d6-82f5-4390-b2f6-efeb8184ed93 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:57.807366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624778d6-82f5-4390-b2f6-efeb8184ed93 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:57.807644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624778d6-82f5-4390-b2f6-efeb8184ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:57.833947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-624778d6-82f5-4390-b2f6-efeb8184ed93 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:57.835230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-624778d6-82f5-4390-b2f6-efeb8184ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:57.926315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 178/365] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:57.990470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dbeeb-dbf2-4236-a328-23a5d6d70739 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:57.991104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dbeeb-dbf2-4236-a328-23a5d6d70739 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:57.991568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dbeeb-dbf2-4236-a328-23a5d6d70739 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:57.993121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 188/366] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:57.998435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade49b5-7656-4a52-b57f-a337e3c9d68c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:57.998721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade49b5-7656-4a52-b57f-a337e3c9d68c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:57.998996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade49b5-7656-4a52-b57f-a337e3c9d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.003587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dbeeb-dbf2-4236-a328-23a5d6d70739 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.024445 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eade49b5-7656-4a52-b57f-a337e3c9d68c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:58.025660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eade49b5-7656-4a52-b57f-a337e3c9d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:58.154331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 179/367] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:58.186692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dbeeb-dbf2-4236-a328-23a5d6d70739 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:58.246741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:58.247401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.247704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.247982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.266309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:58.271457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:58.272340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:58.273171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 189/368] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:58:58.278258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade49b5-7656-4a52-b57f-a337e3c9d68c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.280770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.299277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:58.314196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:58.432105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade49b5-7656-4a52-b57f-a337e3c9d68c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:58.449627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663aaa-efb5-45f4-b68d-3afbfb65891a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:58.480193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61afc2a-3098-48b4-b71b-0e1b4262a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:58.480824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61afc2a-3098-48b4-b71b-0e1b4262a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.481147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61afc2a-3098-48b4-b71b-0e1b4262a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.481709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61afc2a-3098-48b4-b71b-0e1b4262a6c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.490149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:58.490850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.491199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.491537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.492286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:58.492932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:58.493460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61afc2a-3098-48b4-b71b-0e1b4262a6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:58.494467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f61afc2a-3098-48b4-b71b-0e1b4262a6c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:58.499687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:58.500771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:58.501657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:58.502272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 180/369] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:58.505076 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81377095-c247-49fc-acbd-5433b7762cf8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.505589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81377095-c247-49fc-acbd-5433b7762cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.506072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81377095-c247-49fc-acbd-5433b7762cf8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.507551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 181/370] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:58.511747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81377095-c247-49fc-acbd-5433b7762cf8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.514406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 190/371] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:58:58.515492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.596656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:58.598178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:58.621983 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd7ab-c722-4c91-97bc-df4f4657c853 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:58.626683 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81377095-c247-49fc-acbd-5433b7762cf8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:58.656125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:58.656752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.657057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.657330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.662164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79acbb5-4779-482c-9380-0877ea2a5961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:58.662766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79acbb5-4779-482c-9380-0877ea2a5961 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.663045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79acbb5-4779-482c-9380-0877ea2a5961 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.663316 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79acbb5-4779-482c-9380-0877ea2a5961 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.663974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79acbb5-4779-482c-9380-0877ea2a5961 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:58.664281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79acbb5-4779-482c-9380-0877ea2a5961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:58.665657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79acbb5-4779-482c-9380-0877ea2a5961 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:58.667669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:58.673789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:58.674704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:58.675514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:58.676134 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 182/372] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:58.679468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 191/373] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:58.680193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.680391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49727754-fc6d-4070-a6ba-731f238661d3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.680673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49727754-fc6d-4070-a6ba-731f238661d3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.680952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49727754-fc6d-4070-a6ba-731f238661d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.698300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-49727754-fc6d-4070-a6ba-731f238661d3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:58.699471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-49727754-fc6d-4070-a6ba-731f238661d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:58.772014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 183/374] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:58.772921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49727754-fc6d-4070-a6ba-731f238661d3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.787642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd520f5-be01-4f4d-8ba2-86a4b0b1cf90 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:58.824352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:58.825555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.826943 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.827434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.837348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:58.843620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:58.845694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:58.846908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:58.867886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:58.868834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:58.869725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:58.869725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:58.869725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:58.872672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 192/375] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:58.874452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:58.883333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49727754-fc6d-4070-a6ba-731f238661d3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:58.927042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:58.928583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:58.929135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:58.929602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:58.944681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:58.947299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:58.968156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:58.969116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:58.969948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:58.969948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:58.969948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:58.976028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 184/376] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:58.976028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.005728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1231a14-c8d2-4ac2-b3c4-7b0001cf569b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.047583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.048722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.049241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.049711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.050590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:59.051084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.052646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.061630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 193/377] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:59.062835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.080365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d72d7-42dc-4912-b6e9-bae23b3c8f57 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.100880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.120834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.121485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.121765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.122038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.123221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:59.123523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.124367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.125021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.139858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 185/378] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:59.141399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.177163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858efa-76a2-4eb0-8fa7-62ecbc82fd4c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.213641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.214593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.215076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.215538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.216897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:59.217381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.218981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.231755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 194/379] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:59.236520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.248733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f8c2-65ec-4c62-9fac-903968de7154 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.288299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.288936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.289247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.289522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.302200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:58:59.307038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:59.307915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:59.308723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 186/380] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:59.311572 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.341257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ec090-b3a7-4085-9fe5-2fa0efa276fe None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.355661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.356614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.380909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.381600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.381925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.382141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.393954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.395456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:59.411365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:59.412363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:59.413235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:59.413235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:59.413235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:59.413235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 195/381] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:59.414059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.428279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce8635-0842-42d9-86fb-6e3323db0253 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.466261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.467021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.467364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.467703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.475519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.476890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:58:59.490940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:59.492063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:58:59.493248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:59.496661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 187/382] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:59.497579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.519118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873c5c2-6a98-4f4c-b472-ebc84cc0d93e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.552161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.552786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.553090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.553363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.561852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.563292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:58:59.575378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:59.576927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:58:59.577869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 196/383] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:59.578440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.595353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.598269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76398a1-bc3e-4223-9706-78b7f284379b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.603554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.632959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe864c-d8c6-4288-a151-467b3479935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.633586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe864c-d8c6-4288-a151-467b3479935b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.633869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe864c-d8c6-4288-a151-467b3479935b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.634138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe864c-d8c6-4288-a151-467b3479935b None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.634798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe864c-d8c6-4288-a151-467b3479935b None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:59.635098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe864c-d8c6-4288-a151-467b3479935b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.636466 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe864c-d8c6-4288-a151-467b3479935b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.644644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 188/384] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:59.645839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b283fa-f1e9-485b-b9ac-c96a21a02d83 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.646124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b283fa-f1e9-485b-b9ac-c96a21a02d83 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.646396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b283fa-f1e9-485b-b9ac-c96a21a02d83 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.647721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 189/385] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:58:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:58:59.648265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b283fa-f1e9-485b-b9ac-c96a21a02d83 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.678348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3338d8-f5ae-45e7-a103-32643762bfe7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.711141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.711741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.712017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.712283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.712916 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:59.713244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.714612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.726891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 197/386] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:59.727701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.754756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b283fa-f1e9-485b-b9ac-c96a21a02d83 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.787622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.788221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.788501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.788771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.789529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:59.789834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.791254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.807755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.823312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296434fb-8d6f-43a1-b71f-0b1944f08ed5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.828152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 190/387] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:59.829015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.851072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:59.856716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6916-1009-4813-824f-efbf4859d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.857409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6916-1009-4813-824f-efbf4859d40f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.857686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6916-1009-4813-824f-efbf4859d40f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.857953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6916-1009-4813-824f-efbf4859d40f None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.858671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab6916-1009-4813-824f-efbf4859d40f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:59.858973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab6916-1009-4813-824f-efbf4859d40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.860388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab6916-1009-4813-824f-efbf4859d40f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.896433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 198/388] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:59.897959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744809-0fa9-47a7-b3ca-a3df970911e7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.898250 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744809-0fa9-47a7-b3ca-a3df970911e7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.898530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744809-0fa9-47a7-b3ca-a3df970911e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.915579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1d744809-0fa9-47a7-b3ca-a3df970911e7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:59.916779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d744809-0fa9-47a7-b3ca-a3df970911e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:59.927658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7fe38-0a0e-4077-ada9-9ba9510f8688 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:59.961754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:59.962379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:59.962663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:59.962937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:59.977188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:59.979037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:59.983001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 199/389] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:58:59.983838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d744809-0fa9-47a7-b3ca-a3df970911e7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:58:59.993957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:58:59.994840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:58:59.995721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:58:59.995721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:58:59.995721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:58:59.995721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 191/390] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:58:59.995933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.067827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.077261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.102701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff80618-55ac-4986-8986-5fa576e6f600 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.110159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d744809-0fa9-47a7-b3ca-a3df970911e7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.144928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.145586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.145862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.146139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.147232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.147929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.148214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.148486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.155839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.157320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.157493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.158958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:00.171002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:00.171878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:00.172777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 200/391] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:00.173351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:00.178438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:00.179317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:00.180173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:00.180173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.180173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:00.180173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 192/392] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:00.180382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.276561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ce4de-3fef-4a3f-9bf8-db50d7380da9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.289183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb5a37-6783-456f-8297-617759ddbb8d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.305518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.311247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.311876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.312147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.312412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.314034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.322939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.324375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.324585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.325222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.325504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.325779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.326419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:00.326727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.328079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:00.338648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:00.344444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:00.345590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:00.345590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.345590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:00.345590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 201/394] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:00.345859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 193/394] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:00.345939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.346015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.437372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f1c79-4b55-41dc-a94e-752694eb2d0a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.443114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae00a-688a-4186-b81d-ae8898de3329 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.470464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.471064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.471342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.471611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.472330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:00.472633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.474092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.476608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.477227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.477505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.477772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.478399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:00.478695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.480042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.491981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 194/395] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:00.492137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 202/396] 10.222.0.25 () {56 vars in 1139 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:00.493063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.493263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.535126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.540456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.589257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91407a9d-9498-408c-8d15-018d565ae15a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.592905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3465-edb2-409b-b0af-e6651cd6ed65 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.623202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.623828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.624108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.624380 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.625395 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.626017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.626299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.626568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.633779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.634274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.635221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.635712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:00.646295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:00.647190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:00.648077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 195/397] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:00.648640 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:00.650202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:00.651059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:00.651883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:00.651883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.651883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:00.651883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 203/398] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:00.652286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.744071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.749163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755358ff-25cd-4ffd-90b0-20aaef47d961 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.751440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.751580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3fcd-ec57-4ef7-b1c3-7c31654cb185 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.782778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.783376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.783653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.783921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.784583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:00.784871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.784991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.785584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.785811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.786082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.786268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.792572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.794041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.798891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 196/399] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:00.799673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:00.807584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:00.808664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:00.809547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 204/400] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:00.810009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.899691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e6d53-f8b2-420c-a97e-d4102a35bc8e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.906815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57860ea3-f9f2-4969-8c04-32c583189386 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:00.933106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.933726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.933998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.934263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.940183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:00.940778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:00.941087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:00.941364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:00.942084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:00.942388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.943819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.944041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:00.945501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:00.961383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:00.962342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:00.963178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:00.963178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:00.963178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:00.963362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 205/401] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:00.963362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.963484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 197/402] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:00.963557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:00.979823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:00.984574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.065100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43cd9-4a8a-403f-a411-fcf900bb861a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.065712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028a4c-ca7c-4402-8df8-e2a3bfe0c8dd None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.098171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.098334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.098795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.098890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.099071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.099159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.099340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.099437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.100294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:01.100598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.102066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.106232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.108178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.118345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 206/403] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:01.118345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:01.125335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:01.126258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:01.127138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 198/404] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:01.127810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.186815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.206110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.218200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5975-818e-4ca9-82a4-b883cf3b6b1f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.229814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85350793-86b3-4b1f-995e-b0d18b932443 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.251749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.252346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.252621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.252891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.253600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:01.253902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.255314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.262773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.263451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.263726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.263997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.271981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 207/405] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:01.272765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.274203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.275676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:01.290249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:01.291332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:01.292349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:01.292349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:01.292349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:01.292349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 199/406] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:01.292349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.370877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8869d6-60cc-4839-b2a8-77adde7ef23e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.393156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b979b-6c48-443b-9f9a-7c905c355429 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.398814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.404279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.404893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.405179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.405444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.406078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:01.406485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.407737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.418957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 208/407] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:01.419620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.423701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.427742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.428347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.428630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.428906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.429589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.431013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.452116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 200/408] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:59:01 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:01.452895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.548678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b387ea-46af-419c-b344-78f95952d36f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.566425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c315-5e24-4697-bc01-7415dfdc10f0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.585392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.586477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.586846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.587214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.588024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:01.588467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.590095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.603270 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 209/409] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:01.604126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.610701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.611403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.611737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.612018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/96fb635cda454c4a89badd09b8396ccf/roles/dbdb37f44805407aaab363304c78b581` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.629549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=96fb635cda454c4a89badd09b8396ccf, role_id=dbdb37f44805407aaab363304c78b581)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.630932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.653065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 201/410] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:01 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/96fb635cda454c4a89badd09b8396ccf/roles/dbdb37f44805407aaab363304c78b581 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:01.654151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.666830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.709299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.743016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc970bd-a769-4be6-8381-1004af349a77 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.789999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6475097-6543-4004-a102-6fe024172405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.791311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475097-6543-4004-a102-6fe024172405 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.792056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475097-6543-4004-a102-6fe024172405 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.792543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475097-6543-4004-a102-6fe024172405 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.793425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6475097-6543-4004-a102-6fe024172405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:01.793909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6475097-6543-4004-a102-6fe024172405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.794149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cda431-7ddd-4e53-975d-d77badffbdbf None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.796267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6475097-6543-4004-a102-6fe024172405 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.816751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 210/411] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:01.816751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6475097-6543-4004-a102-6fe024172405 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.846602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.847554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.847836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.848593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.856320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:01.861027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:01.870510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:01.871401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:01.872275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 202/412] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:01.872821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:01.951596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6475097-6543-4004-a102-6fe024172405 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:01.988290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:01.989102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:01.989482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:01.989821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/f681d888b56c4fea8acd271e1d51ae3d/roles/dbdb37f44805407aaab363304c78b581` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:01.990007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:01.999779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c16f5-93c7-46c8-b3e5-92d117081f39 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:02.005662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=f681d888b56c4fea8acd271e1d51ae3d, role_id=dbdb37f44805407aaab363304c78b581)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:02.007277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:02.013333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:02.033004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 211/413] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:01 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/f681d888b56c4fea8acd271e1d51ae3d/roles/dbdb37f44805407aaab363304c78b581 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:02.033004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:02.059244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:02.060743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:02.061282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:02.061914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:02.086198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:02.087754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:02.120131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:02.121060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:02.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:02.125532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 203/414] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:02.129793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:02.211829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d9658-5645-4a62-9fdf-fe961832d063 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:02.251575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:02.252186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:02.252464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:02.252786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:02.253531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:02.253837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:02.255317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:02.267647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 212/415] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:02.274194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:02.301526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:02.323391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d044f48-9609-425f-a033-21a037e2c628 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:02.361130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:02.361750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:02.362082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:02.362358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:02.363057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:02.363364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:02.365061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:02.384115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 204/416] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:02.391705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b4f9-802e-4a96-bc97-b576aba61694 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:02.393056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:02.415803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:02.432014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a5bd8-f9f3-4da6-8479-448eb6ac4e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:02.433024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5bd8-f9f3-4da6-8479-448eb6ac4e81 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:02.433500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5bd8-f9f3-4da6-8479-448eb6ac4e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:02.434085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5bd8-f9f3-4da6-8479-448eb6ac4e81 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/1dc28ef7b36746208560692b17809e5d/roles/dbdb37f44805407aaab363304c78b581` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:02.450195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a5bd8-f9f3-4da6-8479-448eb6ac4e81 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=1dc28ef7b36746208560692b17809e5d, role_id=dbdb37f44805407aaab363304c78b581)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:02.452584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a5bd8-f9f3-4da6-8479-448eb6ac4e81 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:02.470889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 213/417] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:02 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/1dc28ef7b36746208560692b17809e5d/roles/dbdb37f44805407aaab363304c78b581 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:02.537355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e95f-dbfc-4e4a-b71d-f1d00d1ca8fa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:02.586431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7b5ce-debe-4941-b675-8505360c324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:02.587119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b5ce-debe-4941-b675-8505360c324e None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:02.587396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b5ce-debe-4941-b675-8505360c324e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:02.587666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b5ce-debe-4941-b675-8505360c324e None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/a17dda73b3ad4896a282dbd1b4cc8bbf/roles/dbdb37f44805407aaab363304c78b581` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:02.608099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7b5ce-debe-4941-b675-8505360c324e None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=a17dda73b3ad4896a282dbd1b4cc8bbf, role_id=dbdb37f44805407aaab363304c78b581)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:02.609618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7b5ce-debe-4941-b675-8505360c324e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:02.624555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 205/418] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:02 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/a17dda73b3ad4896a282dbd1b4cc8bbf/roles/dbdb37f44805407aaab363304c78b581 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:03.928322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0d0d5-5590-463b-83ea-c06a0e81b69a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:03.929372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0d0d5-5590-463b-83ea-c06a0e81b69a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:03.929786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0d0d5-5590-463b-83ea-c06a0e81b69a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:03.931526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 214/419] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:03.937322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001ae5-c25b-42f3-a1ed-0ec737405d0f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:03.938073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001ae5-c25b-42f3-a1ed-0ec737405d0f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:03.938507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001ae5-c25b-42f3-a1ed-0ec737405d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:03.960840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-24001ae5-c25b-42f3-a1ed-0ec737405d0f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:03.962273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-24001ae5-c25b-42f3-a1ed-0ec737405d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:04.037807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:04.048442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 206/420] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:59:04.436605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0d0d5-5590-463b-83ea-c06a0e81b69a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:04.530456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:04.561025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dfa53-2b70-401d-9e7e-769e962f31c4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:04.561501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dfa53-2b70-401d-9e7e-769e962f31c4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:04.561968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dfa53-2b70-401d-9e7e-769e962f31c4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:04.564488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 207/421] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:04.570930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f25e-9ee9-4837-8db2-d80d7329b2ca None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:04.571444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f25e-9ee9-4837-8db2-d80d7329b2ca None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:04.571918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f25e-9ee9-4837-8db2-d80d7329b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:04.578605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0d0d5-5590-463b-83ea-c06a0e81b69a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:04.593122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9a98f25e-9ee9-4837-8db2-d80d7329b2ca None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:04.594705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9a98f25e-9ee9-4837-8db2-d80d7329b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:04.626975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba8d11-6be9-43aa-b60c-4c703c8bab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:04.627616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba8d11-6be9-43aa-b60c-4c703c8bab23 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:04.627894 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba8d11-6be9-43aa-b60c-4c703c8bab23 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:04.628166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba8d11-6be9-43aa-b60c-4c703c8bab23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:04.648843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba8d11-6be9-43aa-b60c-4c703c8bab23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3bba8d11-6be9-43aa-b60c-4c703c8bab23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:04.653838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:04.654745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:04.655533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 215/422] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:04.658247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91507c1-8aa8-4cfc-844b-5878f6df306e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:04.658682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91507c1-8aa8-4cfc-844b-5878f6df306e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:04.659164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91507c1-8aa8-4cfc-844b-5878f6df306e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:04.662446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 216/423] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:04.663177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91507c1-8aa8-4cfc-844b-5878f6df306e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:04.739919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 208/424] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:59:04.742584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d657c-b4a7-41d4-8487-e1640b9f93ab None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:04.743139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d657c-b4a7-41d4-8487-e1640b9f93ab None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:04.743622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d657c-b4a7-41d4-8487-e1640b9f93ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:04.773916 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91507c1-8aa8-4cfc-844b-5878f6df306e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:04.777105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-052d657c-b4a7-41d4-8487-e1640b9f93ab None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:04.779389 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-052d657c-b4a7-41d4-8487-e1640b9f93ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:04.805029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:04.811827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:04.812787 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:04.821575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:04.822066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:04.825054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:04.826418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:04.830968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:04.857597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 217/425] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:04.864659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:04.959667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 209/426] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:05.036218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235f866-5fa6-4513-b5b3-5fa5e140d11b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.048542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d657c-b4a7-41d4-8487-e1640b9f93ab None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.077413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.078613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.078897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.079317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.095947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.097444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:05.125009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:05.125884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:05.126728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:05.126728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:05.126728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:05.126728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 218/427] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:05.133929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.163891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:05.219900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:05.242484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d657c-b4a7-41d4-8487-e1640b9f93ab None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.284431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.285119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.285398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.285669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.299046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:05.304037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:05.304918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:05.305730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 210/428] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:05.306379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.335498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa4cc9-ff91-40eb-9f95-7340dd22f4eb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.371296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.372164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.372658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.373098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.373880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:05.374319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.375820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:05.389070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 219/429] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:05.390209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.422525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3607-2af3-40c8-abb2-a54e76b1c194 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.437889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:05.460153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.460784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.461097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.461369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.473129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:05.479589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:05.480501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:05.482202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 211/430] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:05.485819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.510776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027e16-aea4-4cf6-abb6-e080e9567761 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.520795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:05.554048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112453f-6a92-4310-b3da-c42b44a1e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.554585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112453f-6a92-4310-b3da-c42b44a1e760 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.554890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112453f-6a92-4310-b3da-c42b44a1e760 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.555135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112453f-6a92-4310-b3da-c42b44a1e760 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.555811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112453f-6a92-4310-b3da-c42b44a1e760 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:05.556117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112453f-6a92-4310-b3da-c42b44a1e760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.557551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112453f-6a92-4310-b3da-c42b44a1e760 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:05.566090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 220/431] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:05.567098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef33da-4d3d-4bd1-910d-086890d0f2be None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.567385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef33da-4d3d-4bd1-910d-086890d0f2be None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.567657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef33da-4d3d-4bd1-910d-086890d0f2be None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.569158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 221/432] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:05.569705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef33da-4d3d-4bd1-910d-086890d0f2be None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.605607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1454b-914f-4b1f-879a-2920f5151dcc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.642235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.642967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.643243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.643519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.650530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.651971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:05.663695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:05.664628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 212/433] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:05.665586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.677401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef33da-4d3d-4bd1-910d-086890d0f2be None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.699864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:05.711295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e447-2be5-4fc8-aee9-6089249d2d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.711907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e447-2be5-4fc8-aee9-6089249d2d3b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.712181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e447-2be5-4fc8-aee9-6089249d2d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.712449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e447-2be5-4fc8-aee9-6089249d2d3b None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.713133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e447-2be5-4fc8-aee9-6089249d2d3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:05.713434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e447-2be5-4fc8-aee9-6089249d2d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.714805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e447-2be5-4fc8-aee9-6089249d2d3b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:05.722537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 222/434] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:05.723653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e268-11e8-433b-98f3-48a7f1aadc4c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.723933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e268-11e8-433b-98f3-48a7f1aadc4c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.724253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e268-11e8-433b-98f3-48a7f1aadc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.741345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ed20e268-11e8-433b-98f3-48a7f1aadc4c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:05.742513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed20e268-11e8-433b-98f3-48a7f1aadc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:05.766367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d6b4-7b79-4714-88a2-f12962b97afc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.766501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:05.798612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.799240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.799511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.799783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.808715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 223/435] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:05.810408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.810957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d0ef-0648-400a-8f72-fb28c2d61b48 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.811411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d0ef-0648-400a-8f72-fb28c2d61b48 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.811821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d0ef-0648-400a-8f72-fb28c2d61b48 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.811913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:05.817144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 224/436] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:05.817144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3d0ef-0648-400a-8f72-fb28c2d61b48 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:05.830945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:05.832000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:05.833007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:05.833007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:05.833007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:05.838650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 213/437] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:05.838650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:05.917126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3d0ef-0648-400a-8f72-fb28c2d61b48 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.928208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:05.945741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99554df2-8f1d-448c-92be-5604a6a0b0de None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:05.952369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4076c4-0e3f-42a9-bbda-e8ab7e5eef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.953070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4076c4-0e3f-42a9-bbda-e8ab7e5eef55 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.953446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4076c4-0e3f-42a9-bbda-e8ab7e5eef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.953781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4076c4-0e3f-42a9-bbda-e8ab7e5eef55 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.954570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4076c4-0e3f-42a9-bbda-e8ab7e5eef55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:05.954937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4076c4-0e3f-42a9-bbda-e8ab7e5eef55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.956425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4076c4-0e3f-42a9-bbda-e8ab7e5eef55 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:05.976384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 225/438] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:05.978448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650689-62fa-448b-86ca-8b84633de924 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.979029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650689-62fa-448b-86ca-8b84633de924 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.979441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650689-62fa-448b-86ca-8b84633de924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.984807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:05.985582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:05.985956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:05.986298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:05.998378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:05.999483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-25650689-62fa-448b-86ca-8b84633de924 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:06.000732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-25650689-62fa-448b-86ca-8b84633de924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:06.003056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.015553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:06.022045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:06.023153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:06.028753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:06.028753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:06.028753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:06.028753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 214/439] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:06.028753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.083028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 226/440] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:06.083795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25650689-62fa-448b-86ca-8b84633de924 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.136209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c36c68-1aab-4260-a19b-6e9e5d5cae86 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.169866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.170476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.170757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.171031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.171674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:06.171977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.173359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.180865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.186199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 215/441] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:06.187128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.204202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25650689-62fa-448b-86ca-8b84633de924 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.242231 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.242870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.243153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.243429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.253951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.255413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.265069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:06.272142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:06.273308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:06.274324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:06.274324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:06.274324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:06.280618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 227/442] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:06.280618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.300030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145e4f-0b6b-403e-b8ca-1f6148068c1f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.338413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.339034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.339387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.339729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.340556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:06.340927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.342696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.356433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 216/443] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:06.357950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.379972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded5fe2-d19d-43a5-8a79-53ee21588e0e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.411948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.412578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.412859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.413163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.417208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.424155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:06.429535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:06.430601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 228/444] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:06.433557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.459651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09640cb5-1212-4796-8f1d-f1cfa8488978 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.489664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.494828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.495449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.495727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.495992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.504678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.506151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:06.517781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:06.518866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:06.519770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 217/445] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:06.520334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.532612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a4cf-cbc7-4949-88c7-8de67530afda None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.565529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.566135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.566417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.566697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.567338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:06.567644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.569069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.581422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 229/446] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:06.582204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.617869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3ebcc-2e4f-46ea-8b38-86b69ee2e632 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.634483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.651503 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.652124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.652407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.652677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.663307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:06.668554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:06.669652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 218/447] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:06.670560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.680921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868dafa-410a-4c56-b6f8-2b97757e4706 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.701374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.716826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.717482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.717761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.718030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.725216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.726646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:06.738078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:06.738950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 230/448] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:06.739917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.772475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fac2-6a9a-486e-a8a2-a147ac5ff087 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.804507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.805128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.805407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.805678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.806327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:06.806624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.807969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.816042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 219/449] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:06.816809 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.838558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6997d-5fc1-4352-8bff-c6922822a14b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.857269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.872768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.873331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.873608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.873876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.874590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:06.874894 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.876324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.894214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 231/450] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:06.895074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.915713 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7afd9-f29e-472e-85c4-2c924b12e1c0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:06.933374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:06.948160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:06.948789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:06.949112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:06.949395 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:06.956570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:06.958041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:06.971306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:06.972213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:06.973088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 220/451] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:06.973548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:06.992592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c9acd-fdd5-4afe-9dc6-cf466c2befb5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.025455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.026057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.026336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.026608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.027266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:07.027566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.029024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.036717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 232/452] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:07.037459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.077433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.080397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00397-ca42-4fd3-b4eb-f41e50bebd6b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.118018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.118701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.119075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.119417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.120162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:07.120468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.121965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.135273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.139490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 221/453] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Oct 23 01:59:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:07.140289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78ab8-0c4d-4698-a309-b3e284c1b376 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.140414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.174801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.175427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.175703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.175974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.186073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.187538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:07.201119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:07.202106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:07.202971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:07.202971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:07.202971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:07.202971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 233/454] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:07.203554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.240897 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf875b-b685-4a7b-b846-78a3d18b69b5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.274095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.274698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.274975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.275246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.301645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24bcf6-92a2-4d9f-8f47-6c3941ec8077 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.302055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.335840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.336432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.336708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.337004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.337679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:07.337980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.339393 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.344210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.345691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.351804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 234/455] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:07.352584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.367841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.442719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 222/456] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:07.443544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.453571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777c64-7f84-439a-acac-dc117a0db989 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.487194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.487815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.488091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.488361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.498519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.499262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.500083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:07.514978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:07.515898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:07.516777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:07.516777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:07.516777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:07.516777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 235/457] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:07.517025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.542380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0b3d-ceb2-44f4-b4e9-d24bec99f9fc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.575050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.575703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.575975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.576243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.577652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.615279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9544ca-bcdf-40e2-805c-39389574d61f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.642438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.643917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.648055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.648648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.648925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.649224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.649863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:07.650162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.651520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.662817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 236/458] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:07.663583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.699094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.742343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 223/459] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:07.743168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.768919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed678bc-e1a3-437b-905e-27ea6a5ca914 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.791450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.802907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.803876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.804162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.804439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/349cd8f8431a43a698e9cb4e3536f59a/roles/dbdb37f44805407aaab363304c78b581` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.818946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=349cd8f8431a43a698e9cb4e3536f59a, role_id=dbdb37f44805407aaab363304c78b581)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.820409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.832277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 237/460] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:07 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/349cd8f8431a43a698e9cb4e3536f59a/roles/dbdb37f44805407aaab363304c78b581 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:07.833115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.840607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f235687-f44a-4014-9981-cf61be1a50d1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.880171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.880812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.881123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.881394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.893538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.895587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:07.912999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:07.914029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:07.914885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:07.914885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:07.914885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:07.918970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 224/461] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:07.920419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:07.933977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:07.954756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f9f7e-f3dd-4b61-8a41-a64d3d4cc924 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:07.994005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:07.994617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:07.994900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:07.995172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:07.995842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:07.996129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:07.997589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.010950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 238/462] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:08.011717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.042419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5d20-cbcf-4db3-a133-d61e5ef4d66a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.050827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.082120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.082765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.083025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.083295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.092551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.094441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:08.109921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:08.110883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 01:59:08.111781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:08.116123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 225/463] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:08.117299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.126369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9cb23-2818-4ab7-a638-34dbaa18b473 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.162786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.164200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.164760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.165410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.177136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.178830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.188555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:08.194324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:08.195267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:08.196127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:08.196127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:08.196127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:08.196288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 239/464] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:08.197066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.229765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe04d7-587a-480b-84a5-62ba82e3f77c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.271795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.272637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.273084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.273524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.274302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:08.274758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.276808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.285851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.293722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 226/465] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:08.294779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.306362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1350a4a-d9a9-4b30-a2b0-c8c988771955 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.341440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.342212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.342614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.342987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.351609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.353116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:08.364799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:08.366784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 240/466] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:08.367734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.412001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1588f37-d9cb-4763-adb1-33cfe1bed087 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.442687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.449714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.450377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.450688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.450958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.451702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:08.451972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.453412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.470777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 227/467] 10.222.0.25 () {56 vars in 1139 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:08.471605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.480260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06b37-06c0-49f7-aab3-a4fc388910a5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.516804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.517478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.517757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.518032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.518681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:08.518982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.520372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.537638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 241/468] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:08.537638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.544477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.580867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d0b7-e327-4103-b66e-48ad1cd8650f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.617492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.618121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.618766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.619046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.626655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.628115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:08.640728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:08.641654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:08.642533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:08.643424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c51e3-48a9-453d-b722-908382c8acc2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.646657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 228/469] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:08.647261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.676752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.677398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.677678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.677953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.678739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:08.679043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.680524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.698968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 242/470] 10.222.0.25 () {56 vars in 1137 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:08.701381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.705079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.761086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec717f6-db67-4f34-8824-d0b3e86c8586 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.768907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.798055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.798726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.799010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.799287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.807761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e1629-01ac-40fd-ae4e-196cd22b0d47 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.841711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:08.842343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:08.842630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:08.842906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:08.849766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.851215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:08.862733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:08.863617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 243/471] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:08.869818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.879849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:08.881335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:08.931149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:08.968153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca19d5d-6ddf-45dc-b14a-7d25522b40d7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:08.994868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 229/472] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:08.994868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:08.996318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:09.007490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.008212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.008582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.008941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.009750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:09.010148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.011734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.023845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 244/473] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:09.024823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.104676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5016c-1c5c-40f2-8b94-dd6ea5d0c75f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.137418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18157d-d208-4f36-ad97-0ac447be40e4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.144699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.145425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.145779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.146118 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.164694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:09.177452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.178056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.178337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.178615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.179278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:09.179577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.181014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.192601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 245/474] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:09.193316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.226939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.228381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.241812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:09.297106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5acc41-5f0a-4457-8925-df25ba8baf77 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.331245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.331872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.332154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.332421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.340668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 230/475] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:09.340668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.345297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.346751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:09.361675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:09.362565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:09.363398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:09.363398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:09.363398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:09.363398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 246/476] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:09.363605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.395050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:09.449621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaa09c-ba69-41b4-8658-e466e26b52bc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.463838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:09.471681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d93b71-b5d0-4854-89d2-d47c2dd99b65 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.485718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.486319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.486590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.486857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.487570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] RBAC: Adding query filter params (role.id=dbdb37f44805407aaab363304c78b581, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=96fb635cda454c4a89badd09b8396ccf) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:09.487871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.489343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.495035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 231/477] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/role_assignments?user.id=96fb635cda454c4a89badd09b8396ccf&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=dbdb37f44805407aaab363304c78b581 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:09.495803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.528750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.529419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.529694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.529961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.530712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] RBAC: Adding query filter params (role.id=dbdb37f44805407aaab363304c78b581, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=f681d888b56c4fea8acd271e1d51ae3d) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:09.531012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.532472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.545030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 247/478] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/role_assignments?user.id=f681d888b56c4fea8acd271e1d51ae3d&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=dbdb37f44805407aaab363304c78b581 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:09.545030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.701920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6bef6-35be-4991-b06f-d32258b66378 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.717987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:09.729549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a525-040c-4563-bed4-28b5e11fc573 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.743982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.744945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.745444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.745848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.758559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.760369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.767779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.768648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.769938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.769938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.769938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:09.770475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.771951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:09.781886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:09.782949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:09.784121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:09.784121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:09.784121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:09.785801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 232/479] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:09.789059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 248/480] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:09.791967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.793057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:09.818688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:09.918880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3226cb-cd1f-45a8-8438-7275c2761e42 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:09.959970 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:09.960990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:09.961277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:09.961550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:09.969127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:09.970876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:09.983911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:09.984774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:09.986026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 249/481] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:09.994487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:10.000638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94e0f-40a7-4951-afc0-44d1333c55db None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:10.061571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58c88-4e36-4219-8b51-3e2804383514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:10.062245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58c88-4e36-4219-8b51-3e2804383514 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.062528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58c88-4e36-4219-8b51-3e2804383514 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.062862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58c88-4e36-4219-8b51-3e2804383514 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.063639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58c88-4e36-4219-8b51-3e2804383514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:10.063946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58c88-4e36-4219-8b51-3e2804383514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:10.065734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58c88-4e36-4219-8b51-3e2804383514 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:10.079975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 233/482] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:10.081266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dbbf7-3979-471a-a67f-a1459dde9b96 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.081550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dbbf7-3979-471a-a67f-a1459dde9b96 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.081821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dbbf7-3979-471a-a67f-a1459dde9b96 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.083000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 234/483] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:10.085776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dbbf7-3979-471a-a67f-a1459dde9b96 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:10.116089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:10.123281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:10.144465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6b3b2-1daa-46d9-baa7-d0fbcc30dc04 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:10.183459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b305a6-6d8c-4154-badf-e69639c3e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:10.184076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b305a6-6d8c-4154-badf-e69639c3e2bd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.184326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b305a6-6d8c-4154-badf-e69639c3e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.184642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b305a6-6d8c-4154-badf-e69639c3e2bd None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.185959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b305a6-6d8c-4154-badf-e69639c3e2bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:10.185959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b305a6-6d8c-4154-badf-e69639c3e2bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:10.187179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b305a6-6d8c-4154-badf-e69639c3e2bd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:10.204805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 250/484] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:10.206175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c2d1-90a6-4298-b3c8-7986242175fc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.206456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c2d1-90a6-4298-b3c8-7986242175fc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.206729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c2d1-90a6-4298-b3c8-7986242175fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.223200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dbbf7-3979-471a-a67f-a1459dde9b96 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:10.225522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6948c2d1-90a6-4298-b3c8-7986242175fc None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:10.226692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6948c2d1-90a6-4298-b3c8-7986242175fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:10.271577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:10.272255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.272575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.272846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.280624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:10.282206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:10.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:10.295457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 235/485] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:10.296881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:10.317133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 251/486] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:10.318035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948c2d1-90a6-4298-b3c8-7986242175fc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:10.397365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:10.418740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57c89-09ff-4f6e-8753-7e12bfe2528a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:10.458404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:10.459355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.460004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.460490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.461715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] RBAC: Adding query filter params (role.id=dbdb37f44805407aaab363304c78b581, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=1dc28ef7b36746208560692b17809e5d) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:10.462408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:10.464585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:10.468470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:10.482726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 236/487] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:10 2022] GET /identity/v3/role_assignments?user.id=1dc28ef7b36746208560692b17809e5d&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=dbdb37f44805407aaab363304c78b581 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:10.533400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948c2d1-90a6-4298-b3c8-7986242175fc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:10.587573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:10.588200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.588476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.588750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.589477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:10.589779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:10.591363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:10.612581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 252/488] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:10.618345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:10.703401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:10.780907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e387-6991-4665-bc70-8770cf23e217 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:10.818926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:10.819473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.819750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.820019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.820743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] RBAC: Adding query filter params (role.id=dbdb37f44805407aaab363304c78b581, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=a17dda73b3ad4896a282dbd1b4cc8bbf) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:10.821268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:10.822515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:10.829478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 237/489] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:10 2022] GET /identity/v3/role_assignments?user.id=a17dda73b3ad4896a282dbd1b4cc8bbf&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=dbdb37f44805407aaab363304c78b581 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:10.842479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1dd13-2908-43d9-bb62-e4beda993181 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:10.877006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:10.883879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:10.884921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:10.885461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:10.885965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:10.899273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:10.905423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:10.906373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:10.907144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:10.909966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 253/490] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:10.915595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:10.932833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:11.052358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031b900-70ad-47ee-ba06-7ef0a3556186 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:11.092871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:11.093734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:11.094189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:11.094598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:11.095417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:11.095864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:11.097417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:11.107348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 238/491] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:11.114303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:11.236742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660060-d3af-4883-aef7-cbb0b0b674a9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:11.274714 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:11.275353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:11.275630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:11.275951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:11.287937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:11.289419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:11.303724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:11.304616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:11.306632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:11.306632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:11.306632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:11.306632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 254/492] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:11.311334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:11.391193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:11.418045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a1e5-b6b2-4d7b-9e5b-d164222aff3a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:11.453825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:11.454494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:11.454778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:11.455035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:11.455682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:11.455985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:11.457382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:11.470225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 239/493] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:11.476180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:11.521645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:11.590817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333847a-5b48-4450-af3a-5557b118075c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:11.640676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:11.641345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:11.641620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:11.641888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:11.655255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:11.656700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:11.673859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:11.676166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:11.678357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 255/494] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:11.686122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:11.807611 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276663fd-fa91-49d0-846f-83a75da14e16 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:11.843668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b84b47-aac8-4f50-b7ea-75307d481ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:11.844201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84b47-aac8-4f50-b7ea-75307d481ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:11.844482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84b47-aac8-4f50-b7ea-75307d481ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:11.844752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b84b47-aac8-4f50-b7ea-75307d481ef2 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:11.845513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b84b47-aac8-4f50-b7ea-75307d481ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:11.845818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b84b47-aac8-4f50-b7ea-75307d481ef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:11.847238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b84b47-aac8-4f50-b7ea-75307d481ef2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:11.848955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:11.865876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 240/495] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Oct 23 01:59:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:11.871564 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:11.980864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb82d8-3b70-4d1a-a630-a202780ed172 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:11.982555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:12.020783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:12.021442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.021723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.021998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.101601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:12.102984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:12.177903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97174-c60d-49c1-8f31-cd292a8163dd None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.178209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97174-c60d-49c1-8f31-cd292a8163dd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.178457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97174-c60d-49c1-8f31-cd292a8163dd None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.179780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 241/496] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:12.190198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05c10-0d94-4526-84d1-63ebaf80820c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.190482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05c10-0d94-4526-84d1-63ebaf80820c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.190755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e05c10-0d94-4526-84d1-63ebaf80820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.226298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e7e05c10-0d94-4526-84d1-63ebaf80820c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:12.227534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e7e05c10-0d94-4526-84d1-63ebaf80820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:12.239985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 256/497] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:59:12.245345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:12.257364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:12.327677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 242/498] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:12.329056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c918e4-f64f-449b-87fa-4c175ca00f18 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.329347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c918e4-f64f-449b-87fa-4c175ca00f18 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.329711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c918e4-f64f-449b-87fa-4c175ca00f18 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.331312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 243/499] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:12.342436 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766595-8d5f-4ebf-9be3-917afd9ad95f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.342718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766595-8d5f-4ebf-9be3-917afd9ad95f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.342978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766595-8d5f-4ebf-9be3-917afd9ad95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.385750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c766595-8d5f-4ebf-9be3-917afd9ad95f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:12.389213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c766595-8d5f-4ebf-9be3-917afd9ad95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:12.396635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701fc5d-b5bc-4b7e-a742-109edff3c8ed None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:12.438279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:12.438923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.439201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.439709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.451126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:12.452648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:12.470149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:12.471067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:12.471929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:12.471929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:12.471929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:12.473315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 257/500] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:12.477127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:12.561106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 244/501] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:12.599997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:12.621724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766595-8d5f-4ebf-9be3-917afd9ad95f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:12.678175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0035e-6422-439c-879d-ddc4b026c007 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:12.717433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:12.718044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.718362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.718635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.719279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:12.719575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:12.721007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:12.725881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:12.736154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 258/502] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:12.741886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:12.818462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766595-8d5f-4ebf-9be3-917afd9ad95f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:12.854297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:12.854941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.855222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.855493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.871324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:12.882559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:12.883994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 245/503] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:12.884852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:12.927461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042ae8c-4b10-4464-95f6-c0bf69c5febe None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:12.942558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:12.965199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:12.966271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:12.967039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:12.967740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:12.976101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:12.978521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:12.994701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:12.995801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:12.997074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:12.999741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 259/504] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:13.000668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.022492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7f21-4b48-4ade-abfc-8971519b5e0b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.039655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.069071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.070370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.070754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.071151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.071836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.074021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:13.090521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:13.091889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:13.092744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:13.093645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 246/505] 10.222.0.25 () {56 vars in 1129 bytes} [Sun Oct 23 01:59:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:13.098836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.144674 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33791a1-c481-43e5-84c7-74a5e3b23e43 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.179582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.180259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.180470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.180744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.181444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:13.181754 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.183128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.196319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 260/506] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:13.196319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.225539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131f2b-761e-4889-bdff-7f2d203b0a10 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.229148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.265479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873987-29e4-441b-8322-422c71109dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.266351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873987-29e4-441b-8322-422c71109dad None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.266782 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873987-29e4-441b-8322-422c71109dad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.267222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873987-29e4-441b-8322-422c71109dad None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.268197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe873987-29e4-441b-8322-422c71109dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:13.268651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe873987-29e4-441b-8322-422c71109dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.270366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe873987-29e4-441b-8322-422c71109dad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.283707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 247/507] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:13.284746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873987-29e4-441b-8322-422c71109dad None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.299560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3421b-9f95-4610-ae06-0d1ba807a83c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.326012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.334991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ed39-ef63-4d87-aa1c-a5b8a516c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.335603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ed39-ef63-4d87-aa1c-a5b8a516c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.335888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ed39-ef63-4d87-aa1c-a5b8a516c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.336156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ed39-ef63-4d87-aa1c-a5b8a516c8a1 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.336783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ed39-ef63-4d87-aa1c-a5b8a516c8a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:13.337140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ed39-ef63-4d87-aa1c-a5b8a516c8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.338493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ed39-ef63-4d87-aa1c-a5b8a516c8a1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.343022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 261/508] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:13.344154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a5c0-4a14-406c-a495-607082a664bc None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.344430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a5c0-4a14-406c-a495-607082a664bc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.344694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a5c0-4a14-406c-a495-607082a664bc None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.350170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 262/509] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:13.350924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a5c0-4a14-406c-a495-607082a664bc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.400564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873987-29e4-441b-8322-422c71109dad None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.436375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1809-c14d-43f4-8763-37720291967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.437280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1809-c14d-43f4-8763-37720291967e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.437710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1809-c14d-43f4-8763-37720291967e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.438147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1809-c14d-43f4-8763-37720291967e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.448945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1809-c14d-43f4-8763-37720291967e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.450658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1809-c14d-43f4-8763-37720291967e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.453816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.458733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a5c0-4a14-406c-a495-607082a664bc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-08df1809-c14d-43f4-8763-37720291967e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:13.466841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:13.467807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:13.468699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:13.468699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:13.468699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:13.472752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 248/510] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:13.473633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1809-c14d-43f4-8763-37720291967e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.496452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87fbb-fd61-40c4-b40f-2438ed46e44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.497599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87fbb-fd61-40c4-b40f-2438ed46e44b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.497878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87fbb-fd61-40c4-b40f-2438ed46e44b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.498148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87fbb-fd61-40c4-b40f-2438ed46e44b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.498887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87fbb-fd61-40c4-b40f-2438ed46e44b None admin] RBAC: Adding query filter params (role.id=dbdb37f44805407aaab363304c78b581, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=349cd8f8431a43a698e9cb4e3536f59a) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:13.499165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87fbb-fd61-40c4-b40f-2438ed46e44b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.500589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87fbb-fd61-40c4-b40f-2438ed46e44b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.506540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 263/511] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/role_assignments?user.id=349cd8f8431a43a698e9cb4e3536f59a&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=dbdb37f44805407aaab363304c78b581 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:13.507854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001c14-2148-4d12-80e0-d6387e140310 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.508138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001c14-2148-4d12-80e0-d6387e140310 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.508412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001c14-2148-4d12-80e0-d6387e140310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.527567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d9001c14-2148-4d12-80e0-d6387e140310 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:13.529339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d9001c14-2148-4d12-80e0-d6387e140310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:13.587349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.604375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 264/512] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:13.605533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9001c14-2148-4d12-80e0-d6387e140310 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.609371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1809-c14d-43f4-8763-37720291967e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.691180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe88980-67c3-4ead-b5b9-28d8f972fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.692057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe88980-67c3-4ead-b5b9-28d8f972fd59 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.692490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe88980-67c3-4ead-b5b9-28d8f972fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.692909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe88980-67c3-4ead-b5b9-28d8f972fd59 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.693750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe88980-67c3-4ead-b5b9-28d8f972fd59 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:13.694306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe88980-67c3-4ead-b5b9-28d8f972fd59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.695908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe88980-67c3-4ead-b5b9-28d8f972fd59 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.703482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 249/513] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:13.760404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.769695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9001c14-2148-4d12-80e0-d6387e140310 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.776726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b957db-e815-4db7-9a46-80df73701a67 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.777361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b957db-e815-4db7-9a46-80df73701a67 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.777865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b957db-e815-4db7-9a46-80df73701a67 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.779813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 250/514] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:13.785221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef033c5-e11b-47c1-83c5-769183e4d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.785779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef033c5-e11b-47c1-83c5-769183e4d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.786274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef033c5-e11b-47c1-83c5-769183e4d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.815175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.815815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.816198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.816474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.817168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fef033c5-e11b-47c1-83c5-769183e4d9c2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:13.817307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:13.817476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:13.818695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fef033c5-e11b-47c1-83c5-769183e4d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:13.818872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:13.832639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 265/515] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:13.838001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.910554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 251/516] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:13.940734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef033c5-e11b-47c1-83c5-769183e4d9c2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:13.958710 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cad02f-91f8-4b04-b47a-6d9c9e777a6c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:13.995959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:13.996595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.997405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.997681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.006664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.008084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:14.019882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:14.020849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:14.021858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 266/517] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:14.026664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.045666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:14.047954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:14.079749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef033c5-e11b-47c1-83c5-769183e4d9c2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.151057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.151700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.151973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.152239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] PATH_INFO: `/v3/services/network` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.152824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.154740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:14.173583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:14.174625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:14.175476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 252/518] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:13 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:14.185600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dcff7-c9c6-4968-a4a1-6f39df52af43 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.186105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.223278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.224507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.225038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.225517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.226511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:14.227019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.228754 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.249117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 267/519] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:14.261084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.333223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258696c-d08e-4100-8fd0-8f17fc4b711e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.341367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:14.373527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f55e7b-26f8-4304-9144-18584026f85f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.378209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.379019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.379451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.379863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.380623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:14.381091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.382694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.387935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 253/520] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:14.388858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.406325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:14.423665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.424587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.425258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.425719 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.439822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.442010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:14.462806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:14.463964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:14.465070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:14.465070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:14.465070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:14.472003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 268/521] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:14.473636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.517583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f87d8-3845-4056-a271-845d57e0fba4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.559732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.560376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.560656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.560929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.574061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.576078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:14.592908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:14.593911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:14.594797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:14.594797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:14.594797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:14.594797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 254/522] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:14.595434 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.623912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f59d1-8415-45fe-b44e-0723efb2e5c2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.654020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:14.662045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:14.670883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.672033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.672505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.673128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.674727 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:14.675216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.677118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.685638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 269/523] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:14.686889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.759354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814610f-5852-4a2e-8212-5506c60aefd5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.813086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba6e30-91be-4099-897e-93b45bb42f46 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.853508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.854503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.855432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.856045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.857517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:14.858023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.859944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.874457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.874825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 270/524] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:14.875036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.879441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.879441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.879441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:14.879441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.879441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.881921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.897126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 255/525] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:14.897866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.968179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:15.043080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0a107-897f-4671-a314-ed3c228ca3c9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:15.063540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0c573-8724-4f4a-a946-b63cd0dd6fc7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:15.107160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:15.114163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:15.115218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:15.116303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:15.116888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:15.118381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:15.120132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:15.131647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:15.132656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:15.136548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:15.137001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:15.150133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:15.150133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:15.162650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 271/526] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:59:14 2022] POST /identity/v3/users => generated 254 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:15.175613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:15.176598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:15.177532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 256/527] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:15.184347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:15.330157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83ed6-96f3-4fc2-a54c-be900fe8dbe3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:15.332660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:15.375526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1530a32-8f66-4f73-8271-b245499b1ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:15.376172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530a32-8f66-4f73-8271-b245499b1ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:15.376413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530a32-8f66-4f73-8271-b245499b1ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:15.376684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530a32-8f66-4f73-8271-b245499b1ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:15.377414 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1530a32-8f66-4f73-8271-b245499b1ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:15.377726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1530a32-8f66-4f73-8271-b245499b1ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:15.379230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1530a32-8f66-4f73-8271-b245499b1ff7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:15.393325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 272/528] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:15.398748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:15.512715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ce51a-921c-4ed2-9c25-ca0d3a8f8f70 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:15.548686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231c21-d5f3-4659-bcaa-9c0d4768654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:15.549478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231c21-d5f3-4659-bcaa-9c0d4768654f None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:15.549758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231c21-d5f3-4659-bcaa-9c0d4768654f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:15.550030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231c21-d5f3-4659-bcaa-9c0d4768654f None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/96fb635cda454c4a89badd09b8396ccf/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:15.552043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231c21-d5f3-4659-bcaa-9c0d4768654f None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=96fb635cda454c4a89badd09b8396ccf, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:15.553696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231c21-d5f3-4659-bcaa-9c0d4768654f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:15.568960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 257/529] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:15 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/96fb635cda454c4a89badd09b8396ccf/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:16.095905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35a8ef-d118-4944-9264-e9f6ca80beb7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:16.096290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35a8ef-d118-4944-9264-e9f6ca80beb7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:16.096474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35a8ef-d118-4944-9264-e9f6ca80beb7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:16.098032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 273/530] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:16.103799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949414-79f8-49a6-8e40-74b88e77beab None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:16.104081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949414-79f8-49a6-8e40-74b88e77beab None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:16.104358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949414-79f8-49a6-8e40-74b88e77beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:16.138521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ee949414-79f8-49a6-8e40-74b88e77beab None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:16.139710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ee949414-79f8-49a6-8e40-74b88e77beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:16.189995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:16.242605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 258/531] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:16.314860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed905-ca4b-46dd-9087-9dcee68c9eca None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:16.315220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed905-ca4b-46dd-9087-9dcee68c9eca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:16.315421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed905-ca4b-46dd-9087-9dcee68c9eca None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:16.316957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 274/532] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:16.322403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a44b-e76e-4e91-8124-971d7107efb2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:16.322691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a44b-e76e-4e91-8124-971d7107efb2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:16.322965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a44b-e76e-4e91-8124-971d7107efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:16.350322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-60d2a44b-e76e-4e91-8124-971d7107efb2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:16.351444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-60d2a44b-e76e-4e91-8124-971d7107efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:16.438470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 259/533] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:16.627694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ed905-ca4b-46dd-9087-9dcee68c9eca None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:16.732000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ed905-ca4b-46dd-9087-9dcee68c9eca None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:16.769539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:16.770226 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:16.770502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:16.770772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:16.781154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:16.785958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:16.786880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:16.787723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 275/534] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:16.793154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2a44b-e76e-4e91-8124-971d7107efb2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:16.832982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:16.874374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:16.916309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2a44b-e76e-4e91-8124-971d7107efb2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:16.918757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:16.984230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:16.984849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:16.985158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:16.985431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:16.986098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:16.988007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:16.989424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:17.009232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 260/535] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:17.013015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:17.030379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d85a9-875e-4e6a-96ac-b1577d6fc801 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:17.094777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:17.095396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.095676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.095949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.096944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:17.098518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:17.136843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 276/536] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:16 2022] POST /identity/v3/services => generated 251 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:59:17.173856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea654b7f-4a26-4a7c-ab06-b41f7088d632 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:17.234533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:17.235200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.235480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.235758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.251451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:17.252946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:17.274742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:17.275740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:17.277245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:17.277245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:17.277245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:17.277245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 261/537] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:17.286131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:17.397074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:17.415263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c078-0944-4c8d-8051-6e98cf110dd5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:17.451747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765d35a-3567-4847-bb61-c98c80f67d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:17.452372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765d35a-3567-4847-bb61-c98c80f67d7c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.452655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765d35a-3567-4847-bb61-c98c80f67d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.452928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765d35a-3567-4847-bb61-c98c80f67d7c None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.453598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765d35a-3567-4847-bb61-c98c80f67d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:17.453901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765d35a-3567-4847-bb61-c98c80f67d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:17.455280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765d35a-3567-4847-bb61-c98c80f67d7c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:17.469044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 277/538] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:17.474696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:17.496377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:17.597305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0aac3-6527-40d3-8d68-9b20843a3cc8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:17.605343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17baf5d-557e-485e-a1c4-a5e5965e6dbf None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.605677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17baf5d-557e-485e-a1c4-a5e5965e6dbf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.605895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17baf5d-557e-485e-a1c4-a5e5965e6dbf None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.608024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 278/539] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:17.613155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d406-28b8-45c2-b194-ae48c9d5a09b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.613437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d406-28b8-45c2-b194-ae48c9d5a09b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.613710 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7d406-28b8-45c2-b194-ae48c9d5a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.631993 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a8c7d406-28b8-45c2-b194-ae48c9d5a09b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:17.633227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a8c7d406-28b8-45c2-b194-ae48c9d5a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:17.672091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:17.673710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.673989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.674263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.690936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:17.693786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:17.716295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:17.717305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:17.718233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:17.720353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 262/540] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:17.723624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:17.750353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 279/541] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:59:17.846358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:17.877647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8e442-11f6-4bca-a42a-fd029f2002d1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:17.911804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:17.912427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.912706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.913005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.913783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:17.914091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:17.915522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:17.927739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f3ce-c7c3-4fcc-81d9-1caed0f60079 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.928015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f3ce-c7c3-4fcc-81d9-1caed0f60079 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.928294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f3ce-c7c3-4fcc-81d9-1caed0f60079 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.929925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 280/542] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:59:17.935318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a589c-8a9d-412c-82ef-ee2918e51802 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:17.935594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a589c-8a9d-412c-82ef-ee2918e51802 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:17.935865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a589c-8a9d-412c-82ef-ee2918e51802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:17.941349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 263/543] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Oct 23 01:59:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:17.948272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:17.959241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c80a589c-8a9d-412c-82ef-ee2918e51802 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:17.960412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c80a589c-8a9d-412c-82ef-ee2918e51802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:18.055623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 281/544] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:59:18.056362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a589c-8a9d-412c-82ef-ee2918e51802 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.066552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:18.092753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2550f5-d589-4ac6-b924-4cafa5e30971 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.160782 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:18.173450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.174472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.176002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.176913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.202113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:18.206255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:18.235943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:18.236997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:18.237900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:18.237900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:18.237900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:18.240673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 264/545] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:18.246068 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.298540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a589c-8a9d-412c-82ef-ee2918e51802 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.345060 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e649600-b864-47f0-b5d9-9ba0d63a522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.346121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649600-b864-47f0-b5d9-9ba0d63a522b None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.346409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649600-b864-47f0-b5d9-9ba0d63a522b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.346830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649600-b864-47f0-b5d9-9ba0d63a522b None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.347616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e649600-b864-47f0-b5d9-9ba0d63a522b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:18.350020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e649600-b864-47f0-b5d9-9ba0d63a522b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:18.358570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7642bad-9f29-4247-b4cd-23f93da1300c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.370285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 282/546] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:18 2022] POST /identity/v3/services => generated 240 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:18.372113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3a229-5d50-49af-ab48-1b645e5246e6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.372405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3a229-5d50-49af-ab48-1b645e5246e6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.372850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3a229-5d50-49af-ab48-1b645e5246e6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.375915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 283/547] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:18.376442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3a229-5d50-49af-ab48-1b645e5246e6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.411920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64b3a0-704b-4aa2-901b-d826cb24d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.413216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b3a0-704b-4aa2-901b-d826cb24d13d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.414187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b3a0-704b-4aa2-901b-d826cb24d13d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.414664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b3a0-704b-4aa2-901b-d826cb24d13d None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.415768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64b3a0-704b-4aa2-901b-d826cb24d13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:18.416272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64b3a0-704b-4aa2-901b-d826cb24d13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:18.417890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64b3a0-704b-4aa2-901b-d826cb24d13d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:18.439034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 265/548] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:18.440836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64bc37-74fd-4d39-a52a-91418894bdce None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.441341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64bc37-74fd-4d39-a52a-91418894bdce None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.441990 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64bc37-74fd-4d39-a52a-91418894bdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.462723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:18.464138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bc64bc37-74fd-4d39-a52a-91418894bdce None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:18.466601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bc64bc37-74fd-4d39-a52a-91418894bdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:18.506900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:18.519178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3a229-5d50-49af-ab48-1b645e5246e6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.560207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 266/549] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:18.560207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64bc37-74fd-4d39-a52a-91418894bdce None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.565517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.566168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.566448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.566721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.579580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:18.585447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:18.586360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:18.587184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 284/550] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:18.595152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.663976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64bc37-74fd-4d39-a52a-91418894bdce None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.705142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.705793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.706075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.706348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.714282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:18.717255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:18.718822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79a71e-dc1b-4290-9791-f57e24d0518b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:18.731319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:18.732304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:18.733214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:18.737142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 267/551] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:18.738736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.747799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:18.760231 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.761176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.761461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.761881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.763106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:18.763408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:18.764780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:18.774312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 285/552] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:18.785926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.800303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:18.885315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f7ef0-c7ef-4edd-bb4d-bde078c60037 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.922220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.923369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.923984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.924353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.925171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:18.925567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:18.927295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:18.941092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 268/553] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:18.942158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:18.977649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c045-70a2-4f12-a684-84f886c1978c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.019483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.020399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.020882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.021324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.032950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.034746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.042446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:19.053199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:19.054397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:19.055486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:19.055486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:19.055486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:19.056401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444d76d-da28-4b48-8667-d30bb20c7fb8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.057407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 286/554] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:19.058499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.099556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.100192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.100471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.100744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.103517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:19.121922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:19.126886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:19.127797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:19.128629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:19.132920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 269/555] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:19.133838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.197112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad6b87-546e-4bcc-b17c-e21e71536f86 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.238910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750d1b3-b2b2-4463-9c95-c91de49548f1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.239694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.240861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.242279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.242776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/349cd8f8431a43a698e9cb4e3536f59a/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.244958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=349cd8f8431a43a698e9cb4e3536f59a, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.247692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.266528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 287/556] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:19 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/349cd8f8431a43a698e9cb4e3536f59a/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:19.267682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.293244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.294048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.294334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.294607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.295617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:19.295743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.297202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.326986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 270/557] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:19.332218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.355772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:19.389387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:19.393985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ca0a0-aade-4238-964a-498bee4f36ed None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.434930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.435977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.436463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.436960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.438161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:19.438685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.440556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.452338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 288/558] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:19.462026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.557775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010fdd3-84d6-411c-b51d-2b3a6c288060 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.607986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.609642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.610141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.610636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.611425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d442c0f-4f52-4389-8349-4fcb92a7fcf0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.620140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.622532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:19.639255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:19.640260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:19.641223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:19.642664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 271/559] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 01:59:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:19.650838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.666845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.667535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.667817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.668089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.687212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.688685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:19.714364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:19.715485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:19.716532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:19.716532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:19.716532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:19.716532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 289/560] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:19.721724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.752869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:19.773367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:19.838989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7c927-1caf-448a-a3c3-9be7d6e3b7ce None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.872116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a76de-6408-432e-91b0-0a0ba18a2852 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:19.908560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.909229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.909469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.909739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.910470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:19.910824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.912513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.938212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731928b1-27f6-4f89-9621-4dfde1c7f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:19.938817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731928b1-27f6-4f89-9621-4dfde1c7f8be None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.939152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731928b1-27f6-4f89-9621-4dfde1c7f8be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.939431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731928b1-27f6-4f89-9621-4dfde1c7f8be None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.940087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731928b1-27f6-4f89-9621-4dfde1c7f8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:19.940396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731928b1-27f6-4f89-9621-4dfde1c7f8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:19.941800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731928b1-27f6-4f89-9621-4dfde1c7f8be None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:19.950910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 272/561] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Oct 23 01:59:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:19.956219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:19.968919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 290/562] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:19.970149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8ead-c7da-40d3-9df2-60d502c17b08 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.970443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8ead-c7da-40d3-9df2-60d502c17b08 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.970717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8ead-c7da-40d3-9df2-60d502c17b08 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:19.972066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 291/563] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:19.980997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158c58d-b060-4f61-bff2-19a3808011d2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:19.980997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158c58d-b060-4f61-bff2-19a3808011d2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:19.980997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158c58d-b060-4f61-bff2-19a3808011d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.002369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8158c58d-b060-4f61-bff2-19a3808011d2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:20.004343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8158c58d-b060-4f61-bff2-19a3808011d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:20.075510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb0a15-78e0-4919-9d86-a01ef61fc0ad None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.094709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 292/564] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:20.094709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158c58d-b060-4f61-bff2-19a3808011d2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.098454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:20.120236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:20.132221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.133701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.133980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.134253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.157114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.160658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:20.195218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:20.196237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:20.197169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:20.197169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:20.197169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:20.199363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 273/565] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:20.204300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.304622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158c58d-b060-4f61-bff2-19a3808011d2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.381358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9680f-a84d-4f41-917e-9e2d37f8d048 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.383099 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.383755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.384037 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.384310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.407635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.409303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:20.428948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:20.430176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:20.431183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:20.433276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 293/566] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:20.438569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.441707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.442879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.444341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.444827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.445751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:20.446256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.447854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:20.466532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 274/567] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:20.467194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.517766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:20.520702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:20.563205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a92b07-a941-4a3e-b2be-6fb78a9a921a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.598780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.599849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.600093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.600459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.601162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.602603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:20.606789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741f25e-1b2a-4a17-9500-7fc275fafd9b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:20.615017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:20.616008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:20.616951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 294/568] 10.222.0.25 () {56 vars in 1129 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:20.623147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.651517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.652201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.652494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.652823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.653585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:20.654123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.655425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:20.676594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 275/569] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:20.677764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.748734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e24a7-30bb-4a8d-90d4-63e2d23a0fc0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.776507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:20.788679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.789763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.790283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.790770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.792953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:20.799571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.801260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec892225-178a-44ed-9689-9dde5ff5c845 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.801733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:20.815090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:20.816089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:20.816966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:20.819353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 295/570] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:20.820402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.840034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.840678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.840961 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.841409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.842043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:20.842347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.843709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:20.848763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 276/571] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:20.849886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:20.936556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5c5c-7163-4d8b-9bff-d5dda6e19e16 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.955331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75588fbe-66cd-45ce-9b73-d138d3edd9a5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:20.976133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167637b-6f23-4021-b68f-4fe4a14084ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.976775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167637b-6f23-4021-b68f-4fe4a14084ac None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.977086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167637b-6f23-4021-b68f-4fe4a14084ac None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.977362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167637b-6f23-4021-b68f-4fe4a14084ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.991951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:20.992559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:20.992840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:20.993144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:20.993831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:20.994134 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:20.995555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.008179 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 277/572] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:21.010104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.033924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.037737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.052556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167637b-6f23-4021-b68f-4fe4a14084ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.054477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167637b-6f23-4021-b68f-4fe4a14084ac None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.124166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11d7dd-c5ee-42f1-961f-8ce78c989721 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:21.163722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:21.164333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.164612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.164882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.170626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 296/573] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 01:59:21.170766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:21.170766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.170901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58dbb-d7c5-4c39-86d3-7e5bc8a9b1a9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.170901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58dbb-d7c5-4c39-86d3-7e5bc8a9b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.171047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.171116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58dbb-d7c5-4c39-86d3-7e5bc8a9b1a9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.171116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 297/574] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:21.171116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58dbb-d7c5-4c39-86d3-7e5bc8a9b1a9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.177171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 278/575] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:21.178237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.265583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.270593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.288192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58dbb-d7c5-4c39-86d3-7e5bc8a9b1a9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:21.289941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e3fba-e8dd-4402-9a26-f77e5cd4528c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:21.325177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94cd29-2bba-4a4c-b9ef-c01a8bcc03a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:21.325499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:21.325872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94cd29-2bba-4a4c-b9ef-c01a8bcc03a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.326069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.326180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94cd29-2bba-4a4c-b9ef-c01a8bcc03a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.326351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.326444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94cd29-2bba-4a4c-b9ef-c01a8bcc03a1 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/45303f5dcc7f443ea077ef751eb725bc/roles/dbdb37f44805407aaab363304c78b581` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.326628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.338358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.340050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.340729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94cd29-2bba-4a4c-b9ef-c01a8bcc03a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=45303f5dcc7f443ea077ef751eb725bc, role_id=dbdb37f44805407aaab363304c78b581)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.342286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94cd29-2bba-4a4c-b9ef-c01a8bcc03a1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:21.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:21.365403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:21.366543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:21.366543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:21.366543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:21.366760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 298/576] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:21 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/45303f5dcc7f443ea077ef751eb725bc/roles/dbdb37f44805407aaab363304c78b581 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:21.366846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 279/577] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:21.366846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.366991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c6a5-b934-4ab0-8907-a2af71690be3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.366991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c6a5-b934-4ab0-8907-a2af71690be3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.366991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c6a5-b934-4ab0-8907-a2af71690be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.386599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-12b0c6a5-b934-4ab0-8907-a2af71690be3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:21.387883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-12b0c6a5-b934-4ab0-8907-a2af71690be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:21.483028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 299/578] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:21.484029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0c6a5-b934-4ab0-8907-a2af71690be3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.519204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962a9fb-ea6d-43cd-b045-e044672fe017 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:21.571610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.591818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:21.592787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.593301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.593794 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.594699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] RBAC: Adding query filter params (interface=public, service_id=3c76cc3eb8dd4de3ada907cbc4c3a147, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:21.595201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.597314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.603538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.607709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 280/579] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/endpoints?service_id=3c76cc3eb8dd4de3ada907cbc4c3a147&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:21.613475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.626382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0c6a5-b934-4ab0-8907-a2af71690be3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:21.674054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4727d1a-3adf-47a4-a546-736eecb8b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:21.675224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4727d1a-3adf-47a4-a546-736eecb8b935 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.675665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4727d1a-3adf-47a4-a546-736eecb8b935 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.676085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4727d1a-3adf-47a4-a546-736eecb8b935 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.677176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4727d1a-3adf-47a4-a546-736eecb8b935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:21.678051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4727d1a-3adf-47a4-a546-736eecb8b935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.680124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4727d1a-3adf-47a4-a546-736eecb8b935 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.697027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 300/580] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:21.698512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08da35c-8dc9-4fbd-9569-a7269fe06343 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.698948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08da35c-8dc9-4fbd-9569-a7269fe06343 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.699351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08da35c-8dc9-4fbd-9569-a7269fe06343 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.701103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 301/581] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:21.703788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08da35c-8dc9-4fbd-9569-a7269fe06343 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.736658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd094b-6b1b-4103-abfb-725c526985e2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:21.778551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4bca0-747b-4cd6-b5d5-c37231ec221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:21.779552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4bca0-747b-4cd6-b5d5-c37231ec221c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.779978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4bca0-747b-4cd6-b5d5-c37231ec221c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.780422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4bca0-747b-4cd6-b5d5-c37231ec221c None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.781203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4bca0-747b-4cd6-b5d5-c37231ec221c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.783773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4bca0-747b-4cd6-b5d5-c37231ec221c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.790212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 281/582] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:21.791655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0f316-f060-4f3f-a006-1995c6cdc2fc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.792080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0f316-f060-4f3f-a006-1995c6cdc2fc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.792544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0f316-f060-4f3f-a006-1995c6cdc2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.815780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9ee0f316-f060-4f3f-a006-1995c6cdc2fc None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:21.817500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9ee0f316-f060-4f3f-a006-1995c6cdc2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:21.857067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08da35c-8dc9-4fbd-9569-a7269fe06343 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:21.897004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.898045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:21.909963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 282/583] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:21.911150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0f316-f060-4f3f-a006-1995c6cdc2fc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:21.921132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:21.924991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:21.925453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:21.925898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:21.941046 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:21.944701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:21.968310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:21.969509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:21.970936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 302/584] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:21.976663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.072655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0f316-f060-4f3f-a006-1995c6cdc2fc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.100002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9363-f73e-4b19-a889-2588d6474a21 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.113972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.114957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.115465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.115951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.116790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:22.119207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:22.131151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:22.132252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:22.133176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:22.136673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 283/585] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:22.142472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.147949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.148556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.148833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.149152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.149845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:22.150146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:22.151584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:22.167618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 303/586] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:22.174654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.219613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:22.240792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:22.268018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a58f0e-350b-4bcd-97dd-90bdb7620ce8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.303224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e7c1-da29-470e-beef-2519eb4fe8c2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.311234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.312626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.313146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.313744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.315053 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:22.315975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:22.317891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:22.328116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 284/587] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:22.329097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.344395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.345061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.345344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.345613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.346483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=96fb635cda454c4a89badd09b8396ccf) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:22.346832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:22.348427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:22.355679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 304/588] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/role_assignments?user.id=96fb635cda454c4a89badd09b8396ccf&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:22.356562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.452006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88a2c-fb2c-4068-92e0-a07d19693173 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.482511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:22.499484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.500129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.500412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.500686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.526149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:22.533673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:22.534687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:22.535543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:22.537039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 285/589] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:22.542684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.594616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd8857-e2ca-4270-bd2b-af8ba98dd400 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.620803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:22.654638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4203-18b6-4174-b30d-4f5e76dcf46b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.655479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.656108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.656392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.656666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.657346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:22.657652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:22.659080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:22.667870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 305/590] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:22.676355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.694534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.695148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.695431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.695704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.696361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:22.696765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:22.698254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:22.709923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 286/591] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:22.715954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.766929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:22.796054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ca9f7-60d7-4c83-a467-c2e124def327 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.827478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5863e20-41fa-42ce-92bd-3819144cf391 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:22.851803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.852478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.857023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.857023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:22.857023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] RBAC: Adding query filter params (interface=public, service_id=b282a490ada94b98a34c5547af2b97b7, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:22.857023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:22.857023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:22.866029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 306/592] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/endpoints?service_id=b282a490ada94b98a34c5547af2b97b7&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:22.882659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:22.955126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:22.962510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:22.963158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:22.963432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:22.963698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:23.001802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:23.003263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:23.023702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21ec2-50d5-45cc-8c5c-8c3810d2c5df None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:23.046178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:23.047202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:23.048506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:23.048506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:23.048506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:23.048506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 287/593] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:23.061028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:23.088845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:23.091763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:23.092282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:23.092756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:23.093609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:23.096807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:23.112001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 307/594] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:22 2022] GET /identity/v3/services => generated 772 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:23.293871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:23.301291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f75fd2-6d5a-4c9d-a795-e93bfa616070 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:23.358470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:23.359088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:23.359363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:23.359632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:23.360275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:23.360575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:23.361977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:23.383852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 288/595] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:23.389517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:23.611341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194d588-34ea-45da-9e43-4b68d35591d0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:23.629322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:23.696525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e4e6-f3f5-4187-9c48-977a0d1df772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:23.697195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e4e6-f3f5-4187-9c48-977a0d1df772 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:23.697534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e4e6-f3f5-4187-9c48-977a0d1df772 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:23.697810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e4e6-f3f5-4187-9c48-977a0d1df772 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:23.711462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366e4e6-f3f5-4187-9c48-977a0d1df772 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:23.712929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366e4e6-f3f5-4187-9c48-977a0d1df772 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8366e4e6-f3f5-4187-9c48-977a0d1df772 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:23.728631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:23.729707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:23.731385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 308/596] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:23.736030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:23.852083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab10b4-a61f-4853-a241-8a4ef11dbe53 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:23.852409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab10b4-a61f-4853-a241-8a4ef11dbe53 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:23.852621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab10b4-a61f-4853-a241-8a4ef11dbe53 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:23.854208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 309/597] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:23.864565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f352-0cb6-4403-8980-798b70827c59 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:23.865164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f352-0cb6-4403-8980-798b70827c59 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:23.865164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f352-0cb6-4403-8980-798b70827c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:23.865825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f33c-5b60-4d9d-a050-18d1021924cb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:23.900565 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:23.901210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:23.901489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:23.901759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:23.902484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:23.903319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:23.904246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8997f352-0cb6-4403-8980-798b70827c59 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:23.904749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:23.905476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8997f352-0cb6-4403-8980-798b70827c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:23.923325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 289/598] 10.222.0.25 () {56 vars in 1135 bytes} [Sun Oct 23 01:59:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:23.928370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:23.952550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.033517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 310/599] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:24.089023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd79e8-edce-419e-be76-33cd191c803f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:24.127226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:24.127846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:24.128124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:24.128394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:24.207492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:24.208961 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:24.233193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.334325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 290/600] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 01:59:24.340751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997f352-0cb6-4403-8980-798b70827c59 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:24.383780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:24.498614 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef4e1-74b8-4929-892e-a9da24642542 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:24.514951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.538526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.553143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997f352-0cb6-4403-8980-798b70827c59 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:24.554839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec9d9-34aa-47fe-9a53-96dc3e166df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:24.556183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec9d9-34aa-47fe-9a53-96dc3e166df5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:24.556603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec9d9-34aa-47fe-9a53-96dc3e166df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:24.557039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec9d9-34aa-47fe-9a53-96dc3e166df5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:24.577643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec9d9-34aa-47fe-9a53-96dc3e166df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9b1ec9d9-34aa-47fe-9a53-96dc3e166df5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:24.583257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:24.584369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 01:59:24.585482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:24.593073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 291/601] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 01:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:24.593073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb47093-5c11-46a6-b7cf-9f7dd7a03da5 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:24.593073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb47093-5c11-46a6-b7cf-9f7dd7a03da5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:24.593073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb47093-5c11-46a6-b7cf-9f7dd7a03da5 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:24.593073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 292/602] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:24.595158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb47093-5c11-46a6-b7cf-9f7dd7a03da5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:24.602499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7100e1-2e72-412e-9e23-17df693e17c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:24.603160 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7100e1-2e72-412e-9e23-17df693e17c0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:24.603423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7100e1-2e72-412e-9e23-17df693e17c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:24.603697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7100e1-2e72-412e-9e23-17df693e17c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:24.617767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7100e1-2e72-412e-9e23-17df693e17c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:24.619737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7100e1-2e72-412e-9e23-17df693e17c0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-df7100e1-2e72-412e-9e23-17df693e17c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:24.639494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:24.641415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:24.642306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:24.642306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:24.642306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:24.642306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 311/603] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:24.643496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbad9f-5fd1-4625-98fe-26fc29300e9b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:24.643496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbad9f-5fd1-4625-98fe-26fc29300e9b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:24.643496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbad9f-5fd1-4625-98fe-26fc29300e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:24.666061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-68dbad9f-5fd1-4625-98fe-26fc29300e9b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:24.668028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-68dbad9f-5fd1-4625-98fe-26fc29300e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:24.718198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb47093-5c11-46a6-b7cf-9f7dd7a03da5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:24.743095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 312/604] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:24.744101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbad9f-5fd1-4625-98fe-26fc29300e9b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:24.775799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:24.776462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:24.776742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:24.777026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:24.780450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:24.780767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:24.783551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:24.799754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 293/605] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 01:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:24.805864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:24.882828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.886817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:24.937139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbad9f-5fd1-4625-98fe-26fc29300e9b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:24.993688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:24.994311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:24.994594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:24.994861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:24.995512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:24.995813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:24.997277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.000807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8c46-56e2-4003-b637-0193164f4e25 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.019825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 313/606] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:25.021193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.039799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.041986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.042578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.042860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.058630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.060193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:25.078520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:25.080671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:25.082908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:25.082908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:25.082908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:25.082908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 294/607] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:25.082908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.156759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b1421-48a6-4fc5-b0f8-fead591fe6d1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.185028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:25.198253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6e321-a410-4ab9-b12e-1c2e45874fbc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.207402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.208658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.209108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.209929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.212480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:25.221909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.223359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:25.240059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:25.241220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:25.242083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:25.242880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 314/608] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:25.243361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.245232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.245869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.246149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.247002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.247768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.248951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:25.258616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:25.259624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 01:59:25.260484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:25.264951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 295/609] 10.222.0.25 () {56 vars in 1129 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:25.265887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.387328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b00ea-b369-4e35-8168-9855d21c8bcc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.391465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c63970-ea13-4bd4-9bf8-be8e9c585dfc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.424843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.425513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.425843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.426123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.426764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:25.427066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.428609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.439107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36e14-443e-477f-a56b-68b05ba8dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.440122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36e14-443e-477f-a56b-68b05ba8dced None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.440398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36e14-443e-477f-a56b-68b05ba8dced None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.440663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36e14-443e-477f-a56b-68b05ba8dced None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.441382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36e14-443e-477f-a56b-68b05ba8dced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:25.441797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 315/610] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:25.442541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.445291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36e14-443e-477f-a56b-68b05ba8dced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.447011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36e14-443e-477f-a56b-68b05ba8dced None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.463984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 296/611] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:25.465482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4910b35-2a68-4e48-9d4b-d6577f31d83f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.465762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4910b35-2a68-4e48-9d4b-d6577f31d83f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.466032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4910b35-2a68-4e48-9d4b-d6577f31d83f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.471386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 297/612] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:25.471386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4910b35-2a68-4e48-9d4b-d6577f31d83f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.484150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:25.517585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:25.566481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb4f5-1057-4861-b30a-6fa87c288847 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.575905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4910b35-2a68-4e48-9d4b-d6577f31d83f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.601641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.602362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.602646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.602926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.603529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:25.603833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.605491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.610241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087783f-2ec7-4536-b909-63037b33bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.610872 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087783f-2ec7-4536-b909-63037b33bbcd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.615639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087783f-2ec7-4536-b909-63037b33bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.615757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 316/613] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:25.615857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087783f-2ec7-4536-b909-63037b33bbcd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.615933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.623942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087783f-2ec7-4536-b909-63037b33bbcd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.625499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087783f-2ec7-4536-b909-63037b33bbcd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8087783f-2ec7-4536-b909-63037b33bbcd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:25.638592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:25.639578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:25.640548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 298/614] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:25.641731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eaabc-5f6f-457f-aeed-51eff2753508 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.641731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eaabc-5f6f-457f-aeed-51eff2753508 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.641731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eaabc-5f6f-457f-aeed-51eff2753508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.659259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9f8eaabc-5f6f-457f-aeed-51eff2753508 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:25.660432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9f8eaabc-5f6f-457f-aeed-51eff2753508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:25.725369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e3c35-01b6-4207-b340-d76480cbd064 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.749019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 299/615] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:25.749019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eaabc-5f6f-457f-aeed-51eff2753508 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.751378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:25.755028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:25.775213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.775949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.776370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.776718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.777601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=349cd8f8431a43a698e9cb4e3536f59a) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:25.777982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.779621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.797014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 317/616] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/role_assignments?user.id=349cd8f8431a43a698e9cb4e3536f59a&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:25.797014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:25.922097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eaabc-5f6f-457f-aeed-51eff2753508 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.955438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63aa98-e4c4-4e83-b5d2-cee93cfc17e3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:25.969656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db699-e8e3-44e2-9bb2-ae8cdce3bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:25.970979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db699-e8e3-44e2-9bb2-ae8cdce3bb3e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.971426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db699-e8e3-44e2-9bb2-ae8cdce3bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.972130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db699-e8e3-44e2-9bb2-ae8cdce3bb3e None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.972921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db699-e8e3-44e2-9bb2-ae8cdce3bb3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:25.973417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db699-e8e3-44e2-9bb2-ae8cdce3bb3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:25.975454 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db699-e8e3-44e2-9bb2-ae8cdce3bb3e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:25.982724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 300/617] 10.222.0.25 () {56 vars in 1124 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:25.985031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d770052-6924-4b0c-86e5-b58e98e7b370 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:25.985561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d770052-6924-4b0c-86e5-b58e98e7b370 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:25.986028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d770052-6924-4b0c-86e5-b58e98e7b370 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:25.987827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 301/618] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:25.988752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d770052-6924-4b0c-86e5-b58e98e7b370 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.002501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6ee2c-62cc-402f-a5a1-e57cbac3b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.003493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ee2c-62cc-402f-a5a1-e57cbac3b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.003777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ee2c-62cc-402f-a5a1-e57cbac3b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.004054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ee2c-62cc-402f-a5a1-e57cbac3b0e7 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.005146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6ee2c-62cc-402f-a5a1-e57cbac3b0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:26.005461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6ee2c-62cc-402f-a5a1-e57cbac3b0e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.006942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6ee2c-62cc-402f-a5a1-e57cbac3b0e7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.025832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 318/619] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Oct 23 01:59:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:26.027110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b696ed-c7e8-45dd-b6b9-fde853964fe8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.027396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b696ed-c7e8-45dd-b6b9-fde853964fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.028200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b696ed-c7e8-45dd-b6b9-fde853964fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.052633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a9b696ed-c7e8-45dd-b6b9-fde853964fe8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:26.053862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a9b696ed-c7e8-45dd-b6b9-fde853964fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:26.068116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.090747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.116606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d770052-6924-4b0c-86e5-b58e98e7b370 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.127951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 319/620] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:26.129215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b696ed-c7e8-45dd-b6b9-fde853964fe8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.164650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.165329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.165610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.165928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.166762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.169594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.200518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 302/621] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:26.201539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.247342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b696ed-c7e8-45dd-b6b9-fde853964fe8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.292819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.294482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.294998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.295523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.334968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd84b3-3e32-4f1e-89a7-8a764ae7e644 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.342245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.369576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.397715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.399210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.400800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.401310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.402104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.404478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.405730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.407399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:26.414907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:26.416002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:26.416969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:26.420050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 303/622] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:26.421285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.528258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 320/623] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 01:59:26.529142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.539993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3d2d7-77d2-43ba-82ed-094ed53d3db3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.585603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.586627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.587085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.587648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.588713 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.590760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:26.602705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:26.603788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:26.604679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 304/624] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:26.606178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.607972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.651920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adda6-22cc-497c-939f-37eb5e4b22de None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.671479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.688724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.689370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.689651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.689928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.690777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:26.690905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.692220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.697376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 321/625] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:26.698285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.743188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cef74-45c6-43b0-b019-b5c40e1d02e1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.789974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.791361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.791797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.792495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.803483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4948-a5ee-46f4-a1e3-c0a700899bbc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.807812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.809967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:26.830096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:26.831299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:26.832393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:26.832393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:26.832393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:26.834807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 305/626] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:26.835729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.841466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.848643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:26.850192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:26.850192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:26.850461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:26.851226 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] RBAC: Adding query filter params (name=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:26.851637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:26.853452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:26.864030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 322/627] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:26.864879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:26.970960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b6f9-c0bf-4bdb-8cd5-956a6b1270db None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:26.972769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:26.978951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e89b-de60-4d90-9040-55853878fffb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:27.009914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:27.010671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:27.011056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:27.011465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:27.012223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:27.012789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:27.014137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:27.019502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 306/628] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:27.020709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:27.026278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:27.029692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:27.030186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:27.030600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:27.031435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:27.031880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:27.034384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:27.050665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 323/629] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:27.059568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:27.171612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:27.215185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60259f-2033-40a7-ae90-9e17f73f2ebe None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:27.249229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed5e22-4755-4b26-9541-55c1ca0b459b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:27.258503 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:27.259241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:27.259525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:27.259801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:27.260430 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] RBAC: Adding query filter params (type=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:27.260733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:27.262697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:27.270159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 307/630] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:27.275954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:27.294335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:27.295806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:27.296444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:27.297020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:27.306455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:27.308808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:27.311717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:27.325475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:27.326532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:27.327425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:27.330319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 324/631] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:27.336262 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:27.436300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09f70-57f5-456d-98f5-8a346de56571 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:27.474145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:27.475410 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:27.475839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:27.476254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:27.477117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:27.479075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:27.509918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 308/632] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:27.521673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58071bc-53eb-4345-a717-51c6d616e3d0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:27.546474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:27.588548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1800d31-c951-4e52-948e-b79b99317c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:27.589128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800d31-c951-4e52-948e-b79b99317c8e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:27.589407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800d31-c951-4e52-948e-b79b99317c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:27.589677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800d31-c951-4e52-948e-b79b99317c8e None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:27.590482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1800d31-c951-4e52-948e-b79b99317c8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:27.590787 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1800d31-c951-4e52-948e-b79b99317c8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:27.592256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1800d31-c951-4e52-948e-b79b99317c8e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:27.609742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 325/633] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:27.615935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:27.721054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:27.738543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011253f-669f-434a-a795-01d72f4a3771 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:27.773857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef597bc-aec9-4854-aba7-e382a7197bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:27.774475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef597bc-aec9-4854-aba7-e382a7197bcd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:27.774757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef597bc-aec9-4854-aba7-e382a7197bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:27.775030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef597bc-aec9-4854-aba7-e382a7197bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:27.775750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef597bc-aec9-4854-aba7-e382a7197bcd None admin] RBAC: Adding query filter params (role.id=dbdb37f44805407aaab363304c78b581, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=45303f5dcc7f443ea077ef751eb725bc) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:27.776062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef597bc-aec9-4854-aba7-e382a7197bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:27.778054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef597bc-aec9-4854-aba7-e382a7197bcd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:27.784404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 309/634] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:27 2022] GET /identity/v3/role_assignments?user.id=45303f5dcc7f443ea077ef751eb725bc&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=dbdb37f44805407aaab363304c78b581 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:28.366188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35f38-29e8-48f6-9c56-ecc6ff9aa76e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:28.367373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35f38-29e8-48f6-9c56-ecc6ff9aa76e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:28.367914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35f38-29e8-48f6-9c56-ecc6ff9aa76e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:28.369890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 326/635] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:28.376067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100375d-3722-4534-b317-ba1b0899076a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:28.376593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100375d-3722-4534-b317-ba1b0899076a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:28.377112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100375d-3722-4534-b317-ba1b0899076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:28.395758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6100375d-3722-4534-b317-ba1b0899076a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:28.396997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6100375d-3722-4534-b317-ba1b0899076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:28.471982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 310/636] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:28.535871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3929-6d71-452d-a509-527116f1ffa0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:28.536500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3929-6d71-452d-a509-527116f1ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:28.537015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3929-6d71-452d-a509-527116f1ffa0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:28.538835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 327/637] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:28.544389 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1bc9-e849-480e-9282-c310fce7cc37 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:28.544681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1bc9-e849-480e-9282-c310fce7cc37 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:28.544959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1bc9-e849-480e-9282-c310fce7cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:28.563375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-92de1bc9-e849-480e-9282-c310fce7cc37 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:28.564581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-92de1bc9-e849-480e-9282-c310fce7cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:28.635304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 311/638] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:28.751606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3929-6d71-452d-a509-527116f1ffa0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:28.858365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3929-6d71-452d-a509-527116f1ffa0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:28.893586 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:28.894143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:28.894419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:28.894684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:28.895260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:28.896620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:28.908924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:28.909936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:28.910770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:28.911492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de1bc9-e849-480e-9282-c310fce7cc37 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:28.912128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 328/639] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:28.913252 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:28.937339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:28.954449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:29.026878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de1bc9-e849-480e-9282-c310fce7cc37 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:29.042239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de5008-9ead-4b79-be1e-8acbc8a6ffa3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:29.071603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:29.073200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:29.073496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:29.073763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:29.074427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:29.075822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:29.090573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:29.091600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:29.092722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 312/640] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:29.097676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:29.097800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:29.098565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:29.099254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:29.099602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:29.100369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:29.100738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:29.102219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:29.115826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 329/641] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:29.122414 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:29.197215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:29.231480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98cc69-a5bb-4c45-a7f8-2133c78f75cb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:29.251073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:29.256344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53689-cd79-4eb3-b462-71aeef2e1d57 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:29.269784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:29.270752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:29.271174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:29.271648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:29.272458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:29.273058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:29.274687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:29.280407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 313/642] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:29.285956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:29.297196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa012c6f-e2ee-4543-afcb-a1a2c1b96f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:29.297891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012c6f-e2ee-4543-afcb-a1a2c1b96f6e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:29.298258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012c6f-e2ee-4543-afcb-a1a2c1b96f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:29.298885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa012c6f-e2ee-4543-afcb-a1a2c1b96f6e None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:29.299524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa012c6f-e2ee-4543-afcb-a1a2c1b96f6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:29.299831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa012c6f-e2ee-4543-afcb-a1a2c1b96f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:29.301837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa012c6f-e2ee-4543-afcb-a1a2c1b96f6e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:29.313015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 330/643] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:29.405661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552b61c-6d24-4e3f-a81b-fe9bd1c2f004 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:29.446609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17ec6d-ffc8-4fd5-bf7c-d1cc14dae810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:29.447295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17ec6d-ffc8-4fd5-bf7c-d1cc14dae810 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:29.447519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17ec6d-ffc8-4fd5-bf7c-d1cc14dae810 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:29.447791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17ec6d-ffc8-4fd5-bf7c-d1cc14dae810 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:29.448435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17ec6d-ffc8-4fd5-bf7c-d1cc14dae810 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:29.448742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17ec6d-ffc8-4fd5-bf7c-d1cc14dae810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:29.450738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17ec6d-ffc8-4fd5-bf7c-d1cc14dae810 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:29.456098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 314/644] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:29.533518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c28ee6-e85b-4b3c-b69c-46c607b11794 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:29.534052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c28ee6-e85b-4b3c-b69c-46c607b11794 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:29.534052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c28ee6-e85b-4b3c-b69c-46c607b11794 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:29.535741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 331/645] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:29.541596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4231-3148-481f-8bfe-a1ab2bb70caf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:29.542097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4231-3148-481f-8bfe-a1ab2bb70caf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:29.542173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4231-3148-481f-8bfe-a1ab2bb70caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:29.549319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:29.563161 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-52ae4231-3148-481f-8bfe-a1ab2bb70caf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:29.564363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-52ae4231-3148-481f-8bfe-a1ab2bb70caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:29.640921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 315/646] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:29.909969 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c28ee6-e85b-4b3c-b69c-46c607b11794 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:30.021772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c28ee6-e85b-4b3c-b69c-46c607b11794 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:30.056216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e278012-3356-481a-8d3a-8761daa9ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:30.056827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e278012-3356-481a-8d3a-8761daa9ed35 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:30.057133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e278012-3356-481a-8d3a-8761daa9ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:30.057404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e278012-3356-481a-8d3a-8761daa9ed35 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:30.058056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e278012-3356-481a-8d3a-8761daa9ed35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:30.059944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e278012-3356-481a-8d3a-8761daa9ed35 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:30.077064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 332/647] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:29 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:30.090877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4bf5-8697-4434-a290-d0e76eed4b29 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:30.091174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4bf5-8697-4434-a290-d0e76eed4b29 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:30.091427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4bf5-8697-4434-a290-d0e76eed4b29 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:30.094322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 316/648] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:30.099343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76610d-ea36-48af-af31-dd79a369c67c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:30.099669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76610d-ea36-48af-af31-dd79a369c67c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:30.099896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76610d-ea36-48af-af31-dd79a369c67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:30.127096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3c76610d-ea36-48af-af31-dd79a369c67c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:30.128383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c76610d-ea36-48af-af31-dd79a369c67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:30.155569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:30.219289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 333/649] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:30 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:30.494390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4bf5-8697-4434-a290-d0e76eed4b29 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:30.603734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4bf5-8697-4434-a290-d0e76eed4b29 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:30.635530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:30.641127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:30.641758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:30.642034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:30.642359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:30.653405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:30.658351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:30.659302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:30.660163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:30.663660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 317/650] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Oct 23 01:59:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:30.665893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76610d-ea36-48af-af31-dd79a369c67c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:30.769747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76610d-ea36-48af-af31-dd79a369c67c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:30.804668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:30.805366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:30.805645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:30.805914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:30.806584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:30.806882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:30.808237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:30.821087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 334/651] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Oct 23 01:59:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:30.822754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:30.941645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d797f-ba2a-434f-b379-b2b59d8a87d3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:30.983534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:30.985329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:30.985329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:30.985329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:30.995243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:30.996736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:31.017361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:31.018353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:31.019258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:31.019258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:31.019258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:31.019258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 318/652] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:31.030107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:31.044310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:31.156818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052ea8e-ef38-445b-b8c5-f7dc671ba209 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:31.191688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:31.192304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.192583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.192854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.193582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:31.193887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:31.195264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:31.208823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 335/653] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:31.216463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:31.268380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:31.328643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1322c-363d-4d35-8943-3ac06c33d919 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:31.364625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:31.365302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.365580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.365850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.374224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:31.375659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:31.386871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:31.387934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:31.388998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:31.392702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 319/654] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 01:59:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:31.398092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:31.475056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:31.514550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e4a43-c575-4623-80d9-37ce108fc499 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:31.555924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2746d-d1d1-4df9-85ca-806df48108d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:31.557600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2746d-d1d1-4df9-85ca-806df48108d0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.558057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2746d-d1d1-4df9-85ca-806df48108d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.559113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2746d-d1d1-4df9-85ca-806df48108d0 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.560014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2746d-d1d1-4df9-85ca-806df48108d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:31.560508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2746d-d1d1-4df9-85ca-806df48108d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:31.562147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2746d-d1d1-4df9-85ca-806df48108d0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:31.585145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 336/655] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Oct 23 01:59:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:31.587015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:31.640341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76683-096e-4be8-9014-1623f80c420f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.640709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76683-096e-4be8-9014-1623f80c420f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.641286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76683-096e-4be8-9014-1623f80c420f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.643113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 337/656] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:59:31.648133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696d77-aa76-4d76-a45c-e3f07f4cf691 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.648642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696d77-aa76-4d76-a45c-e3f07f4cf691 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.649227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7696d77-aa76-4d76-a45c-e3f07f4cf691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.668817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c7696d77-aa76-4d76-a45c-e3f07f4cf691 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:31.670947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c7696d77-aa76-4d76-a45c-e3f07f4cf691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:31.701741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d4198-f79a-428d-a5bc-3fe4fcbe7866 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:31.705344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:31.747405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c6195-6067-42a6-908e-978137f8258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:31.748035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6195-6067-42a6-908e-978137f8258c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.748315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6195-6067-42a6-908e-978137f8258c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.748582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6195-6067-42a6-908e-978137f8258c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.757289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 338/657] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:31 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:31.759610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c6195-6067-42a6-908e-978137f8258c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:31.761085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c6195-6067-42a6-908e-978137f8258c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-124c6195-6067-42a6-908e-978137f8258c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:31.775581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:31.776545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:31.777495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:31.777495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:31.777495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:31.781303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 320/658] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:31.782636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7696d77-aa76-4d76-a45c-e3f07f4cf691 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:31.806639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd92a-f780-4e69-a964-bd01f9e2dd0f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.807008 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd92a-f780-4e69-a964-bd01f9e2dd0f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.807207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd92a-f780-4e69-a964-bd01f9e2dd0f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.813028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 321/659] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:31.814140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fb571-ec97-4e31-804f-6da2be9a9423 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.814421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fb571-ec97-4e31-804f-6da2be9a9423 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.814694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fb571-ec97-4e31-804f-6da2be9a9423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.832749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-450fb571-ec97-4e31-804f-6da2be9a9423 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:31.834030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-450fb571-ec97-4e31-804f-6da2be9a9423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:31.845887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:31.897413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7696d77-aa76-4d76-a45c-e3f07f4cf691 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:31.909882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 322/660] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:31 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:31.936603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:31.937250 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:31.937527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:31.937799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:31.938437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:31.938735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:31.940165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:31.956457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 339/661] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:31.957895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fb571-ec97-4e31-804f-6da2be9a9423 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:32.035452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:32.047599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:32.070921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fb571-ec97-4e31-804f-6da2be9a9423 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:32.120814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:32.122004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:32.122277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:32.122545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:32.131317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:32.133062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:32.147920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:32.148822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:32.149740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:32.152780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca791-ea2c-476b-ac8d-d9a254d06594 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:32.154274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 323/662] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:32.156521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:32.184134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:32.197650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:32.198258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:32.198532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:32.198797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:32.199511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:32.200871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:32.217050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 340/663] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:32 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:59:32.217884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:32.282642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9a2b7-2ae3-46b0-8602-f5eff723b605 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:32.335148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:32.335148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:32.335493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:32.335731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:32.336558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:32.336874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:32.338413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:32.352878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 324/664] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:32.362026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:32.367663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:32.387986 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512b200-022b-4a18-8207-58490d639cf5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:32.437306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedaa768-e0ce-4d2c-b930-b1a4dc59f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:32.438221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaa768-e0ce-4d2c-b930-b1a4dc59f2a1 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:32.438504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaa768-e0ce-4d2c-b930-b1a4dc59f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:32.439318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaa768-e0ce-4d2c-b930-b1a4dc59f2a1 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:32.439608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedaa768-e0ce-4d2c-b930-b1a4dc59f2a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:32.440999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedaa768-e0ce-4d2c-b930-b1a4dc59f2a1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:32.459464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 341/665] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:32 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:32.460800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d6f6-f155-4498-a8d7-68b63269aa56 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:32.461120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d6f6-f155-4498-a8d7-68b63269aa56 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:32.461401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d6f6-f155-4498-a8d7-68b63269aa56 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:32.462919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 342/666] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:32.469168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91d8a1-e553-47a7-ad72-2976f3666caf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:32.469457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91d8a1-e553-47a7-ad72-2976f3666caf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:32.469734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91d8a1-e553-47a7-ad72-2976f3666caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:32.494715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6a91d8a1-e553-47a7-ad72-2976f3666caf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:32.496081 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a91d8a1-e553-47a7-ad72-2976f3666caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:32.499495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659e30a-75e6-4bc5-a8d0-4e80d51ff4b9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:32.531259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:32.553636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:32.554325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:32.555213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:32.555500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/45303f5dcc7f443ea077ef751eb725bc/roles/1b18e92eaa8e415eb14da2397a7cde68` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:32.558347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=45303f5dcc7f443ea077ef751eb725bc, role_id=1b18e92eaa8e415eb14da2397a7cde68)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:32.559945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:32.580018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 325/667] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:32 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/45303f5dcc7f443ea077ef751eb725bc/roles/1b18e92eaa8e415eb14da2397a7cde68 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:32.580656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 343/668] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:32.861875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:32.924079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:32.967949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd9b6-c624-424b-bc6c-3c349cc18e97 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:33.004376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:33.005363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:33.005648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:33.005924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:33.006510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:33.007889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:33.017273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:33.018491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:33.019755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 326/669] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Oct 23 01:59:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:33.024667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91d8a1-e553-47a7-ad72-2976f3666caf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:33.130233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91d8a1-e553-47a7-ad72-2976f3666caf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:33.165994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:33.166962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:33.167467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:33.168537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:33.169408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:33.169941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:33.171517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:33.177246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 344/670] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:33.185308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:33.290312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8440b-b834-4c1f-a27d-ea00cf3aa517 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:33.313541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:33.326151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:33.326767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:33.327047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:33.327317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:33.328004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:33.328308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:33.329742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:33.335112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 327/671] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:33.341048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:33.373664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:33.447382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f2a16-f2d8-4453-baa8-99cd276874ea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:33.483211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5062-999a-44b5-8f33-9c807276c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:33.483828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5062-999a-44b5-8f33-9c807276c041 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:33.484111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5062-999a-44b5-8f33-9c807276c041 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:33.484386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5062-999a-44b5-8f33-9c807276c041 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:33.485118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea5062-999a-44b5-8f33-9c807276c041 None admin] RBAC: Adding query filter params (interface=public, service_id=355b0d9947294369a08891ed48a87286, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:33.485429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea5062-999a-44b5-8f33-9c807276c041 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:33.486792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea5062-999a-44b5-8f33-9c807276c041 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:33.492084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 345/672] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 01:59:33 2022] GET /identity/v3/endpoints?service_id=355b0d9947294369a08891ed48a87286&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:33.498345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:33.609758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffa4de-8728-4ef0-a819-df6e0b133fc5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:33.645218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18903801-327b-4f6a-95df-3f6b3a2d2897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:33.646119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18903801-327b-4f6a-95df-3f6b3a2d2897 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:33.646603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18903801-327b-4f6a-95df-3f6b3a2d2897 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:33.647117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18903801-327b-4f6a-95df-3f6b3a2d2897 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:33.647915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18903801-327b-4f6a-95df-3f6b3a2d2897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:33.649514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18903801-327b-4f6a-95df-3f6b3a2d2897 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:33.656678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 328/673] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:33 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:59:34.476467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c342c2f-3690-40be-ab09-7a3d13d55140 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:34.477051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c342c2f-3690-40be-ab09-7a3d13d55140 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:34.477051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c342c2f-3690-40be-ab09-7a3d13d55140 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:34.478641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 346/674] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:34.484033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02805e-d4ed-43e5-9ec7-3fec3d8d65d0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:34.484446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02805e-d4ed-43e5-9ec7-3fec3d8d65d0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:34.484599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02805e-d4ed-43e5-9ec7-3fec3d8d65d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:34.503569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9c02805e-d4ed-43e5-9ec7-3fec3d8d65d0 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:34.504759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9c02805e-d4ed-43e5-9ec7-3fec3d8d65d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:34.555560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:34.584117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 329/675] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:34.720117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07bd86-07e2-40b9-87fb-c755d3e1f8f2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:34.720461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07bd86-07e2-40b9-87fb-c755d3e1f8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:34.720681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07bd86-07e2-40b9-87fb-c755d3e1f8f2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:34.722378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 347/676] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:34.727903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43806a0-1280-41ab-beb0-f82975dcf2df None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:34.728132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43806a0-1280-41ab-beb0-f82975dcf2df None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:34.728407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43806a0-1280-41ab-beb0-f82975dcf2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:34.747019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d43806a0-1280-41ab-beb0-f82975dcf2df None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:34.748212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d43806a0-1280-41ab-beb0-f82975dcf2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:34.823453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 330/677] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:34.860172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07bd86-07e2-40b9-87fb-c755d3e1f8f2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:34.885802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4319bb-379d-4a7f-b503-338ea1a18be0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:34.886114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4319bb-379d-4a7f-b503-338ea1a18be0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:34.886612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4319bb-379d-4a7f-b503-338ea1a18be0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:34.888895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 331/678] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:34.894713 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957e0d3-b67a-48da-9519-c75780bb46f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:34.895004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957e0d3-b67a-48da-9519-c75780bb46f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:34.895279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957e0d3-b67a-48da-9519-c75780bb46f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:34.914353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9957e0d3-b67a-48da-9519-c75780bb46f9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:34.915547 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9957e0d3-b67a-48da-9519-c75780bb46f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:34.966916 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:34.971518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07bd86-07e2-40b9-87fb-c755d3e1f8f2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.010074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.010972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.011457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.011876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.012669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.013101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 332/679] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:35.014382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:35.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:35.025076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:35.026121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.028786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 348/680] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:35.034877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957e0d3-b67a-48da-9519-c75780bb46f9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.084058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:35.104214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.146301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957e0d3-b67a-48da-9519-c75780bb46f9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.182714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.183932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.184534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.184908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.185665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:35.186060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.187533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.193021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 333/681] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:35.198331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.247819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da5b83-d0bc-4fcc-a0e3-27124673cd56 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.294709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.295271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.295554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.295829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.296582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.298368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.308760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c694f-9095-49a9-87c4-c19423370955 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.311957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:35.312458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:35.313479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.314930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 349/682] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:35.315753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.344144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:35.356725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.357638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.358100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.358551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.359360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:35.359868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.361966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.368432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 334/683] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:35.373846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.426862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0628eec-beb2-4f13-bd50-e220b3fd8017 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.461525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.462144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.462429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.462699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.473611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:35.478851 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041d58-8bc7-42be-b277-91da2f0e8bb6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:35.479197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:35.480549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 350/684] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:35.481823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.520715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.521415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.521637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.521913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.522527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:35.522826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.524183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.529853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 335/685] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:35.530624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.565611 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:35.578952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:35.596880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886d11-f56c-4a1a-9b61-cf461e354835 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.631341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.631945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.632222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.632503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.633239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] RBAC: Adding query filter params (interface=public, service_id=9d9f24cf7d7242099435233c2102f8b6, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:35.633550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.634935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.645635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 351/686] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/endpoints?service_id=9d9f24cf7d7242099435233c2102f8b6&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:35.645802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b5bf-771e-48cc-b72a-471f44d87c32 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.645925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.682551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.683405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.683822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.684168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.684897 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:35.685404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.686829 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.700561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 336/687] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:35.700561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.752219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af8078-1c47-4744-816a-f130347ee68d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.787504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.788125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.788401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.788676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.789337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:35.789657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.791016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.800807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 352/688] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:35.800807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.809060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:35.816810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:35.818047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfa4a6-a1fd-440b-b8b3-9ea8a3b92426 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.853904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.854625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.854979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.855894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.856566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.857956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.863808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 337/689] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:59:35.864578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.907367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f277bd-aaf5-4a06-ba4e-68e55264e984 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:35.947144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72680a1-21b4-474b-8f24-ff0ebecc7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:35.948364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72680a1-21b4-474b-8f24-ff0ebecc7cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.948910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72680a1-21b4-474b-8f24-ff0ebecc7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.949532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72680a1-21b4-474b-8f24-ff0ebecc7cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.963727 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72680a1-21b4-474b-8f24-ff0ebecc7cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:35.965759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72680a1-21b4-474b-8f24-ff0ebecc7cb6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b72680a1-21b4-474b-8f24-ff0ebecc7cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:35.981020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:35.982203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:35.983546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:35.983546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:35.983546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:35.983546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 353/690] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:35.983546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e8ec3-a06f-4db5-b41b-775eb3bc935c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:35.983844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e8ec3-a06f-4db5-b41b-775eb3bc935c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:35.983912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e8ec3-a06f-4db5-b41b-775eb3bc935c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:35.989014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 354/691] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:35.989014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e8ec3-a06f-4db5-b41b-775eb3bc935c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:35.994044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94435e-cccc-448c-8df0-02e277db75db None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.031729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226aeb-ef69-41c2-8efd-43477445a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.032346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226aeb-ef69-41c2-8efd-43477445a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.032625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226aeb-ef69-41c2-8efd-43477445a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.032893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226aeb-ef69-41c2-8efd-43477445a0d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.033653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68226aeb-ef69-41c2-8efd-43477445a0d7 None admin] RBAC: Adding query filter params (interface=public, service_id=a2b4d4241a91414db771c63ecbeebaf0, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:36.033970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68226aeb-ef69-41c2-8efd-43477445a0d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.035368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68226aeb-ef69-41c2-8efd-43477445a0d7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.041103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 338/692] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/endpoints?service_id=a2b4d4241a91414db771c63ecbeebaf0&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:36.042318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f67b2-4826-45db-aead-5c2a1d6fc846 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.042775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f67b2-4826-45db-aead-5c2a1d6fc846 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.043060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f67b2-4826-45db-aead-5c2a1d6fc846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.064812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-159f67b2-4826-45db-aead-5c2a1d6fc846 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:36.065274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:36.066699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-159f67b2-4826-45db-aead-5c2a1d6fc846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:36.087828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:36.112026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e8ec3-a06f-4db5-b41b-775eb3bc935c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.145829 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 339/693] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:36.146597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f67b2-4826-45db-aead-5c2a1d6fc846 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.161353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.162291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.162769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.163359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.164097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:36.164468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.166048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.184164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 355/694] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:36.186144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.275868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f67b2-4826-45db-aead-5c2a1d6fc846 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.300182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da20ee4-21ce-4a0b-a46f-c231527934e7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.317766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.318754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.319287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.319802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.320605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.322473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.326204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:36.331579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 340/695] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:59:36.348279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.349643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.350193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.350675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.360140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.362101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:36.376830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:36.377876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 01:59:36.378822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:36.381562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 356/696] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:36.388461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.409996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:36.456772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.509601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b4e69-1997-4df1-ac95-2c16118e6f7d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.556843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.557491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.557735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.558009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.559283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:36.559583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.561116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.584371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 341/697] 10.222.0.25 () {56 vars in 1149 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:36.586028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.588749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871c06f-0b08-4cd1-a4e1-68a0f66832aa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.627730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.628283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.628556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.628826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.629657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.631026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:36.644960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:36.645977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 01:59:36.646889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:36.653095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 357/698] 10.222.0.25 () {56 vars in 1132 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:36.656267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.685558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:36.716822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731744c-4f18-4f88-97a7-ca3175c2e09c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.719149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:36.760382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.761033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.761387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.761664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.786346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226ea45-99a9-4583-ab7c-ca4577e28fd2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.828529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:36.829793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:36.830294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:36.830907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:36.832186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:36.832804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.834863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.841389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 358/699] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:36.850341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.850520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:36.850676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:36.930049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:36.962151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 342/700] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 01:59:36.968177 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:36.975701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d541f4e-fa5a-4587-9f07-d6ad9318f7dd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:36.989844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:37.013704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:37.014657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:37.015146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:37.015620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:37.016503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:37.017029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:37.018603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:37.029023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 359/701] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:37.030136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:37.075577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e671f23-fb1e-4012-8b1e-dd618786a532 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:37.112186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:37.115595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:37.115595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:37.115595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:37.128255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:37.129949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:37.145636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:37.146636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:37.147607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:37.147607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:37.147607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:37.147607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 343/702] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:37.153407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:37.155483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398488-0d1a-45cc-bab2-009a6c45bb08 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:37.185008 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:37.195407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:37.196314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:37.196769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:37.197442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:37.198307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:37.199921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:37.226424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 360/703] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:37.265191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91340-94e2-4370-b936-971a558c63ba None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:37.313479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:37.314151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:37.314488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:37.314760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:37.315411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:37.315709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:37.317121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:37.331226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 344/704] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:37.336864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:37.373027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:37.454330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e17dd-87f0-4d2e-bfba-2676d3b24041 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:37.489685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:37.490363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:37.490643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:37.490961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:37.498449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:37.499953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:37.511268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:37.512187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:37.513093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 361/705] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:37.518200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:37.603734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:37.623049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572b0b-b883-4620-89b5-8e51dc61b548 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:37.658254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c29608-5318-4266-a2ff-b9c5e9a0080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:37.658855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c29608-5318-4266-a2ff-b9c5e9a0080f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:37.659129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c29608-5318-4266-a2ff-b9c5e9a0080f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:37.659390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c29608-5318-4266-a2ff-b9c5e9a0080f None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:37.660069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c29608-5318-4266-a2ff-b9c5e9a0080f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:37.660367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c29608-5318-4266-a2ff-b9c5e9a0080f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:37.661805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c29608-5318-4266-a2ff-b9c5e9a0080f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:37.675195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 345/706] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:37.681074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:37.780725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:37.794631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe73bc-ebfb-4731-8784-1e143af7ff56 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:37.829233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f601b-a4d9-4323-a0fb-b880cecbe093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:37.829834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f601b-a4d9-4323-a0fb-b880cecbe093 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:37.830109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f601b-a4d9-4323-a0fb-b880cecbe093 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:37.830377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f601b-a4d9-4323-a0fb-b880cecbe093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:37.831097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f601b-a4d9-4323-a0fb-b880cecbe093 None admin] RBAC: Adding query filter params (role.id=1b18e92eaa8e415eb14da2397a7cde68, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=45303f5dcc7f443ea077ef751eb725bc) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:37.831398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f601b-a4d9-4323-a0fb-b880cecbe093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:37.832821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f601b-a4d9-4323-a0fb-b880cecbe093 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:37.839142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 362/707] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:37 2022] GET /identity/v3/role_assignments?user.id=45303f5dcc7f443ea077ef751eb725bc&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=1b18e92eaa8e415eb14da2397a7cde68 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:38.050451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a04b1-0b4a-4ddd-a72f-9168540fd67f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:38.050793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a04b1-0b4a-4ddd-a72f-9168540fd67f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:38.050973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a04b1-0b4a-4ddd-a72f-9168540fd67f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:38.052603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 346/708] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:38.058707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb198582-2fa8-4e2c-8a03-b4981c3486a3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:38.059240 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb198582-2fa8-4e2c-8a03-b4981c3486a3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:38.059712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb198582-2fa8-4e2c-8a03-b4981c3486a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:38.079761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-eb198582-2fa8-4e2c-8a03-b4981c3486a3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:38.081331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eb198582-2fa8-4e2c-8a03-b4981c3486a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:38.157577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 363/709] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:38.430704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a04b1-0b4a-4ddd-a72f-9168540fd67f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:38.538654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a04b1-0b4a-4ddd-a72f-9168540fd67f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:38.573493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093bb97-fb8f-4c5f-9c28-c5103a8b64bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:38.575032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093bb97-fb8f-4c5f-9c28-c5103a8b64bd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:38.575511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093bb97-fb8f-4c5f-9c28-c5103a8b64bd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:38.575980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093bb97-fb8f-4c5f-9c28-c5103a8b64bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:38.576748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093bb97-fb8f-4c5f-9c28-c5103a8b64bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:38.578389 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093bb97-fb8f-4c5f-9c28-c5103a8b64bd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8093bb97-fb8f-4c5f-9c28-c5103a8b64bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:38.588067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:38.589157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:38.590067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:38.592837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 347/710] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:38.602070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb198582-2fa8-4e2c-8a03-b4981c3486a3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:38.611743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b693-06a4-44e2-8554-0117470d2c90 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:38.612241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b693-06a4-44e2-8554-0117470d2c90 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:38.612363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b693-06a4-44e2-8554-0117470d2c90 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:38.613760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 348/711] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:59:38.618619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42952a-e7c3-4a06-ad27-0580cc308b0c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:38.618896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42952a-e7c3-4a06-ad27-0580cc308b0c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:38.619165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42952a-e7c3-4a06-ad27-0580cc308b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:38.635284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:38.638021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7d42952a-e7c3-4a06-ad27-0580cc308b0c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:38.639219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7d42952a-e7c3-4a06-ad27-0580cc308b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:38.705417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:38.714858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 349/712] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:38.724675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb198582-2fa8-4e2c-8a03-b4981c3486a3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:38.759947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:38.760552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:38.760827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:38.761242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:38.761871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:38.762169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:38.763539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:38.768680 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 364/713] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:38.774503 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42952a-e7c3-4a06-ad27-0580cc308b0c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:38.878671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42952a-e7c3-4a06-ad27-0580cc308b0c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:38.917853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:38.918457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:38.918735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:38.919002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:38.919615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:38.919910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:38.921298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:38.923289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:38.928416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 350/714] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:38.938053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:38.988891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:39.047824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716c8f-2e0f-4a6e-815a-938a19d05f22 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:39.083574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:39.084175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:39.084456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:39.084730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:39.085430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:39.086849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:39.117617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 365/715] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:39.125820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0cf4-972d-4169-8dc3-a38333addad9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:39.173333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:39.174290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:39.174781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:39.175195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:39.175983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:39.177602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:39.188192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:39.189478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 01:59:39.190472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:39.193311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 351/716] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:39.205095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:39.209404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:39.314291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d01a0-d921-46f1-b78c-372b157253d1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:39.348895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:39.349534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:39.349811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:39.350078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:39.350693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:39.350992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:39.352354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:39.358962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 366/717] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:39.364752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:39.428516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:39.472680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95d63-2124-4358-b3e3-743595ca0dd9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:39.512287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b073d5-6d17-4872-9957-778f0677d602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:39.512904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b073d5-6d17-4872-9957-778f0677d602 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:39.513225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b073d5-6d17-4872-9957-778f0677d602 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:39.513500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b073d5-6d17-4872-9957-778f0677d602 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:39.514136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b073d5-6d17-4872-9957-778f0677d602 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:39.514439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b073d5-6d17-4872-9957-778f0677d602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:39.515798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b073d5-6d17-4872-9957-778f0677d602 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:39.521230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 352/718] 10.222.0.25 () {56 vars in 1114 bytes} [Sun Oct 23 01:59:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:39.526624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:39.608211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:39.641739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d7aa8-add2-473a-8210-991cabf0651a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:39.656091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece815-58a9-4f8e-bec6-8100ee667898 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:39.656599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece815-58a9-4f8e-bec6-8100ee667898 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:39.656599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece815-58a9-4f8e-bec6-8100ee667898 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:39.658718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 353/719] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:39.663470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa554af0-0fb1-40e4-8abc-0ae643110ed4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:39.663751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa554af0-0fb1-40e4-8abc-0ae643110ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:39.664025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa554af0-0fb1-40e4-8abc-0ae643110ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:39.679755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:39.680598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:39.681136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:39.681574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:39.682504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:39.683486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fa554af0-0fb1-40e4-8abc-0ae643110ed4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:39.684672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fa554af0-0fb1-40e4-8abc-0ae643110ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:39.684884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:39.707515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 367/720] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:39.782567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 354/721] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:40.048088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:40.162764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ffc85-5aaf-4bb7-8227-f5f7817e5078 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:40.188809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:40.197652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a0c16-561e-4abb-a671-d799f88a6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:40.198286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a0c16-561e-4abb-a671-d799f88a6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:40.198593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a0c16-561e-4abb-a671-d799f88a6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:40.198859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a0c16-561e-4abb-a671-d799f88a6ff3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:40.199446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a0c16-561e-4abb-a671-d799f88a6ff3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:40.200820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a0c16-561e-4abb-a671-d799f88a6ff3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-692a0c16-561e-4abb-a671-d799f88a6ff3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:40.209886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:40.210860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:40.211687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:40.215531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 368/722] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:40.218150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa554af0-0fb1-40e4-8abc-0ae643110ed4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:40.225500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2d34-efa6-4923-b701-e2145a3627f7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:40.226043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2d34-efa6-4923-b701-e2145a3627f7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:40.226520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2d34-efa6-4923-b701-e2145a3627f7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:40.229908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 369/723] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:59:40.235692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a97986-fa38-4f5c-b63e-20e31bb5b147 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:40.236213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a97986-fa38-4f5c-b63e-20e31bb5b147 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:40.236784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a97986-fa38-4f5c-b63e-20e31bb5b147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:40.256607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-42a97986-fa38-4f5c-b63e-20e31bb5b147 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:40.258111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-42a97986-fa38-4f5c-b63e-20e31bb5b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:40.272063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:40.336409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa554af0-0fb1-40e4-8abc-0ae643110ed4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:40.337265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 370/724] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:40.369193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:40.369799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:40.370074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:40.370344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:40.370993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] RBAC: Adding query filter params (name=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:40.371289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:40.372638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:40.377765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 355/725] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:40.383501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a97986-fa38-4f5c-b63e-20e31bb5b147 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:40.487307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a97986-fa38-4f5c-b63e-20e31bb5b147 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:40.508271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:40.522676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:40.523295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:40.523575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:40.523845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:40.524473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:40.524773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:40.526237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:40.531756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 371/726] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:40.626095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:40.735194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37608-014c-49fb-a99b-cb9acdab9fbe None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:40.750720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:40.772613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:40.773266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:40.773540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:40.773803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] PATH_INFO: `/v3/services/image` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:40.774371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:40.775721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:40.784652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:40.785674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:40.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:40.790728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 356/727] 10.222.0.25 () {56 vars in 1105 bytes} [Sun Oct 23 01:59:40 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:40.792077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:40.894069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bdac5-930e-449b-b1e3-1f8244cd4479 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:40.928910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d912ed4-b35e-43aa-ac84-84ed159a30c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:40.929549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d912ed4-b35e-43aa-ac84-84ed159a30c3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:40.929825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d912ed4-b35e-43aa-ac84-84ed159a30c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:40.930092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d912ed4-b35e-43aa-ac84-84ed159a30c3 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:40.930718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d912ed4-b35e-43aa-ac84-84ed159a30c3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:40.931017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d912ed4-b35e-43aa-ac84-84ed159a30c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:40.932382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d912ed4-b35e-43aa-ac84-84ed159a30c3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:40.937699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 372/728] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:40.944251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:41.054061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47953-b28e-49c5-91a8-62702b91fd5e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:41.091881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53f61-effa-437c-ad6d-9d10f32e75b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:41.092842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53f61-effa-437c-ad6d-9d10f32e75b4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:41.093360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53f61-effa-437c-ad6d-9d10f32e75b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:41.093844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53f61-effa-437c-ad6d-9d10f32e75b4 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:41.094695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53f61-effa-437c-ad6d-9d10f32e75b4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:41.095187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53f61-effa-437c-ad6d-9d10f32e75b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:41.096732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53f61-effa-437c-ad6d-9d10f32e75b4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:41.109156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 357/729] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:41.444493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205d80d-70be-44fc-8036-4394923ef864 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:41.444874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205d80d-70be-44fc-8036-4394923ef864 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:41.445078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205d80d-70be-44fc-8036-4394923ef864 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:41.446646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 373/730] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:41.452723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ff4c0-7489-48a5-a981-129b71b86d94 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:41.453036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ff4c0-7489-48a5-a981-129b71b86d94 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:41.453317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ff4c0-7489-48a5-a981-129b71b86d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:41.471966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f50ff4c0-7489-48a5-a981-129b71b86d94 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:41.473192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f50ff4c0-7489-48a5-a981-129b71b86d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:41.512427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:41.547237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 358/731] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:41.822511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205d80d-70be-44fc-8036-4394923ef864 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:41.876619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:41.928137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc262ed9-41e4-4cc4-b5fa-c02d57d027cf None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:41.928655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc262ed9-41e4-4cc4-b5fa-c02d57d027cf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:41.928655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc262ed9-41e4-4cc4-b5fa-c02d57d027cf None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:41.930116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 359/732] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:41.933777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205d80d-70be-44fc-8036-4394923ef864 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:41.935605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd58b-0c80-4cd5-af1f-2b2be31a245b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:41.935891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd58b-0c80-4cd5-af1f-2b2be31a245b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:41.936167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd58b-0c80-4cd5-af1f-2b2be31a245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:41.954711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4f8dd58b-0c80-4cd5-af1f-2b2be31a245b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:41.956093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4f8dd58b-0c80-4cd5-af1f-2b2be31a245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:41.971173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:41.971797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:41.972075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:41.972349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:41.972930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:41.974684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:41.983929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:41.985172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:41.986281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 374/733] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:41.991557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:42.045281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 360/734] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:42.107856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502d5c-661d-44a2-a3a5-f63cbb2266bc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:42.126673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:42.148863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:42.149519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.149799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.150074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.150696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:42.150996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:42.152408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:42.157347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 375/735] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:42.166080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd58b-0c80-4cd5-af1f-2b2be31a245b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:42.273840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd58b-0c80-4cd5-af1f-2b2be31a245b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:42.275402 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:42.311378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:42.311991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.312270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.312541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.313198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:42.313502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:42.314855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:42.320147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 361/736] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:42.327003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:42.334823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:42.436260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a3f43-ae6c-432a-8344-59012b5fa0af None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:42.452940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d44313-812d-41b2-95b3-5359048521b3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:42.472658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fec34-8d29-4934-b791-88566515da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:42.473751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fec34-8d29-4934-b791-88566515da4d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.474176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fec34-8d29-4934-b791-88566515da4d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.474588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fec34-8d29-4934-b791-88566515da4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.475442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fec34-8d29-4934-b791-88566515da4d None admin] RBAC: Adding query filter params (interface=admin, service_id=9d9f24cf7d7242099435233c2102f8b6, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:42.475917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fec34-8d29-4934-b791-88566515da4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:42.477458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fec34-8d29-4934-b791-88566515da4d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:42.483358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 376/737] 10.222.0.25 () {56 vars in 1249 bytes} [Sun Oct 23 01:59:42 2022] GET /identity/v3/endpoints?service_id=9d9f24cf7d7242099435233c2102f8b6&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:42.489934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fec34-8d29-4934-b791-88566515da4d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:42.494754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:42.496150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.496573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.497010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.497850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:42.499441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:42.502472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING keystone.server.flask.common [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 23 01:59:42.523568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.sql.core [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 01:59:42.523568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:59:42.523568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [parameters: {'id': '0de15b6f778f45e395640753b35ffd7b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 01:59:42.523568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0de15b6f778f45e395640753b35ffd7b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0de15b6f778f45e395640753b35ffd7b. Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:59:42.533223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 01:59:42.534200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application yield resource Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise self.value Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application session.commit() Oct 23 01:59:42.535235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:59:42.536171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 01:59:42.537199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:59:42.538140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [parameters: {'id': '0de15b6f778f45e395640753b35ffd7b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:42.539236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:42.540033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0de15b6f778f45e395640753b35ffd7b. Oct 23 01:59:42.541125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.543777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:42.549310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 362/738] 10.222.0.25 () {60 vars in 1140 bytes} [Sun Oct 23 01:59:42 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:42.552342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:42.579969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:42.606138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fec34-8d29-4934-b791-88566515da4d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:42.642715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:42.643364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.643646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.643924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.644756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:42.645951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:42.657071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 377/739] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:42 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:59:42.672670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a075-4999-4ebe-ba8c-5a31dcc43b77 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:42.716645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947351f-045d-4a8f-89e1-ea941273b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:42.717736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947351f-045d-4a8f-89e1-ea941273b394 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.718259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947351f-045d-4a8f-89e1-ea941273b394 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.718731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947351f-045d-4a8f-89e1-ea941273b394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.728266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947351f-045d-4a8f-89e1-ea941273b394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:42.730529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947351f-045d-4a8f-89e1-ea941273b394 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d947351f-045d-4a8f-89e1-ea941273b394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:42.744051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:42.745022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:42.746499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:42.748711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 363/740] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:42.755089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:42.829194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d17d-614f-44c6-9860-2de78fdaf990 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.829465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d17d-614f-44c6-9860-2de78fdaf990 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.829739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d17d-614f-44c6-9860-2de78fdaf990 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.838112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 364/741] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:42.840050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403671de-a2c4-4300-b608-573b472912eb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.840335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403671de-a2c4-4300-b608-573b472912eb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.840605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403671de-a2c4-4300-b608-573b472912eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.861860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-403671de-a2c4-4300-b608-573b472912eb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:42.863708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-403671de-a2c4-4300-b608-573b472912eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:42.870596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19c196-e81d-4f2a-8b85-fe317f836645 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:42.873364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:42.911125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:42.911740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:42.912020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:42.912297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:42.912963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:42.913293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:42.914730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:42.934968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 378/742] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:42.949325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 365/743] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:43.213194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:43.296714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc925-86f1-461e-8dd0-f924e933d2d2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:43.297064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc925-86f1-461e-8dd0-f924e933d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:43.297302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc925-86f1-461e-8dd0-f924e933d2d2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:43.298872 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 366/744] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:43.303793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e8d75-9eb4-48a0-a1c8-2fd66a389dc8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:43.304070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e8d75-9eb4-48a0-a1c8-2fd66a389dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:43.304338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e8d75-9eb4-48a0-a1c8-2fd66a389dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:43.321651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760a1c-7c12-49d1-b1d5-547a4d87b3f2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:43.323359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-565e8d75-9eb4-48a0-a1c8-2fd66a389dc8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:43.324788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-565e8d75-9eb4-48a0-a1c8-2fd66a389dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:43.337294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:43.363009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:43.363893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:43.364323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:43.364741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:43.365587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:43.367095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:43.387206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 379/745] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:43 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:43.425019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 367/746] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:43.687623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:43.714788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:43.794461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ecad-ee30-432d-85b2-da8c4c293279 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:43.828510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7c19b-2add-4486-b83d-a9821fd75197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:43.829521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c19b-2add-4486-b83d-a9821fd75197 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:43.829996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c19b-2add-4486-b83d-a9821fd75197 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:43.830460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7c19b-2add-4486-b83d-a9821fd75197 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:43.831311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7c19b-2add-4486-b83d-a9821fd75197 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:43.832874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7c19b-2add-4486-b83d-a9821fd75197 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:43.848900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 380/747] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:43 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:44.974030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc873-86c5-45e7-bbb2-cdb96bbe9f66 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:44.974554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc873-86c5-45e7-bbb2-cdb96bbe9f66 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:44.974554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc873-86c5-45e7-bbb2-cdb96bbe9f66 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:44.976170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 368/748] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:44.981708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5687-ed2d-45fb-832e-6da8c2b96a83 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:44.982106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5687-ed2d-45fb-832e-6da8c2b96a83 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:44.982271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb5687-ed2d-45fb-832e-6da8c2b96a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.001452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-20cb5687-ed2d-45fb-832e-6da8c2b96a83 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:45.002636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20cb5687-ed2d-45fb-832e-6da8c2b96a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:45.079798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 381/749] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:44 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:45.228551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105411cc-1a25-4b62-baba-b1abd0211ee9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.229242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105411cc-1a25-4b62-baba-b1abd0211ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.230251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105411cc-1a25-4b62-baba-b1abd0211ee9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.232198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 369/750] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:45.237668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61c9b-9b52-459e-96d7-aa41c52bb6e1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.238175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61c9b-9b52-459e-96d7-aa41c52bb6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.238650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61c9b-9b52-459e-96d7-aa41c52bb6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.257900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-20f61c9b-9b52-459e-96d7-aa41c52bb6e1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:45.259373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20f61c9b-9b52-459e-96d7-aa41c52bb6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:45.263782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:45.330696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 382/751] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:45 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:45.371699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105411cc-1a25-4b62-baba-b1abd0211ee9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:45.483749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105411cc-1a25-4b62-baba-b1abd0211ee9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:45.518694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24d2c-4914-400c-a146-1b5a3f9cbc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:45.519327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24d2c-4914-400c-a146-1b5a3f9cbc5d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.519605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24d2c-4914-400c-a146-1b5a3f9cbc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.519930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24d2c-4914-400c-a146-1b5a3f9cbc5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.520510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24d2c-4914-400c-a146-1b5a3f9cbc5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:45.521961 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24d2c-4914-400c-a146-1b5a3f9cbc5d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-33c24d2c-4914-400c-a146-1b5a3f9cbc5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:45.531771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:45.532791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.533712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 370/752] 10.222.0.25 () {56 vars in 1126 bytes} [Sun Oct 23 01:59:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:45.538817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f61c9b-9b52-459e-96d7-aa41c52bb6e1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:45.577266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d7616-b2f4-4c81-a796-d03c6417a1d9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.577266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d7616-b2f4-4c81-a796-d03c6417a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.577266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d7616-b2f4-4c81-a796-d03c6417a1d9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.577266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 371/753] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:59:45.582162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836ba9-b889-4e63-8b98-7081dc0b7521 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.582445 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836ba9-b889-4e63-8b98-7081dc0b7521 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.582720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836ba9-b889-4e63-8b98-7081dc0b7521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.590341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:45.602238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0e836ba9-b889-4e63-8b98-7081dc0b7521 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:45.603542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e836ba9-b889-4e63-8b98-7081dc0b7521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:45.652888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f61c9b-9b52-459e-96d7-aa41c52bb6e1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:45.678450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 372/754] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:45 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:45.679636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836ba9-b889-4e63-8b98-7081dc0b7521 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:45.691204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:45.691552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.691914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.692263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.692989 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:45.693375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:45.694855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:45.705147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 383/755] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:45.706125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:45.709802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:45.806808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836ba9-b889-4e63-8b98-7081dc0b7521 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:45.826030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c104e-cae7-454e-8c95-2eaa78b3c1c8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:45.840517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:45.847674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:45.848705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.849112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.849459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.850164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:45.851661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:45.868137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.sql.core [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 01:59:45.868137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 01:59:45.868137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [parameters: {'user_id': '8771f0860fa8406c9cee6b1d95260078', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 01:59:45.868137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 01:59:45.871667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:45.872537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:45.873060 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:45.873501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:45.874294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:45.874762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:59:45.875508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:59:45.876376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application yield resource Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise self.value Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application session.commit() Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:59:45.877356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:59:45.878615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:59:45.879477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:59:45.880289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [parameters: {'user_id': '8771f0860fa8406c9cee6b1d95260078', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:45.882009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 23 01:59:45.883650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 373/756] 10.222.0.25 () {60 vars in 1131 bytes} [Sun Oct 23 01:59:45 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:45.885488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:45.888122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:45.895075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 384/757] 10.222.0.25 () {56 vars in 1122 bytes} [Sun Oct 23 01:59:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:45.900751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:45.984061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:46.010170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a7a4b-0ec5-4bb0-bd1f-605e154d12ce None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.020092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72f45-0b99-4d88-b901-4468983df540 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.047437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.048068 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.048349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.048618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.055980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.056791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd1920-5c38-49bc-8808-dbec946b7c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.057748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd1920-5c38-49bc-8808-dbec946b7c73 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.057855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.058291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd1920-5c38-49bc-8808-dbec946b7c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.058729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd1920-5c38-49bc-8808-dbec946b7c73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.059643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd1920-5c38-49bc-8808-dbec946b7c73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.061198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd1920-5c38-49bc-8808-dbec946b7c73 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:46.069875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:46.070982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 374/758] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:46.072247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.081838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 385/759] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:46.083329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94f23-2a1a-4bd1-ab42-132e06335de4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.083757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94f23-2a1a-4bd1-ab42-132e06335de4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.084185 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94f23-2a1a-4bd1-ab42-132e06335de4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.085577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 386/760] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:46.086417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94f23-2a1a-4bd1-ab42-132e06335de4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.141459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:46.193730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675fb9-b041-47e3-bc2c-d1558bf5a7e3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.222816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94f23-2a1a-4bd1-ab42-132e06335de4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.234737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03303d-90cd-4a6d-9819-45c38d611ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.235732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03303d-90cd-4a6d-9819-45c38d611ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.236296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03303d-90cd-4a6d-9819-45c38d611ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.236578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03303d-90cd-4a6d-9819-45c38d611ea2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.237198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03303d-90cd-4a6d-9819-45c38d611ea2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.238601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03303d-90cd-4a6d-9819-45c38d611ea2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.249753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6b03303d-90cd-4a6d-9819-45c38d611ea2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:46.250274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:46.251297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:46.252138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 375/761] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:46.253988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc64e-2276-4426-8353-e01655638711 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.254269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc64e-2276-4426-8353-e01655638711 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.254541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc64e-2276-4426-8353-e01655638711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.270343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.270960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.271243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.271512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.272214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:46.272517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.273969 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.275711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4e8fc64e-2276-4426-8353-e01655638711 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:46.277836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4e8fc64e-2276-4426-8353-e01655638711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:46.312529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 387/762] 10.222.0.25 () {56 vars in 1101 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:46.313406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.355691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 376/763] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:46 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:46.423707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c6144-1b59-4945-a0ce-cfc7fb3add53 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.460122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.460749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.461050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.461326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.461965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:46.462267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.463742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.470347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 388/764] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:46.476042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fc64e-2276-4426-8353-e01655638711 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.535529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:46.589643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fc64e-2276-4426-8353-e01655638711 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.624539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.625182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.625461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.625730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.626360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] RBAC: Adding query filter params (type=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:46.626661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.628014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.636444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 377/765] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:46.640130 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.641950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.709946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:46.758255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b942-5a9f-4de2-b43e-6d20e45b5eac None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.769116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429b54c-86d7-4f23-8aa6-8bda6129c5f0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.773288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:46.797385 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.798004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.798285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.798558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.799261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] RBAC: Adding query filter params (interface=public, service_id=2274c784592943e4883b0052a9528223, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:46.799569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.800929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.810691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 378/766] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/endpoints?service_id=2274c784592943e4883b0052a9528223&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:46.811693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.811804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.812363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.812647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.812925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] PATH_INFO: `/v3/services/image` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.813537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.814902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:46.824814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:46.825899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:46.826732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:46.831140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 389/767] 10.222.0.25 () {56 vars in 1105 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:46.831700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:46.918675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b75eb-f5a6-4aed-b9a8-ecba54d5182c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.944112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea22d6-b15a-4de7-add4-0c60b103453a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:46.952506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.953359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.953787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.954201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.954640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:46.954947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.956360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:46.973006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 379/768] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:59:46.986803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:46.987450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:46.987903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:46.988234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:46.988997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] RBAC: Adding query filter params (name=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:46.989376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:46.990887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:47.002142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 390/769] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:47.003268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:47.051726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:47.122913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6cf47-2ca3-4427-ba82-83cc23db01c1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:47.159857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:47.160608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:47.160764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:47.161040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:47.161645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] RBAC: Adding query filter params (type=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:47.161950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:47.163306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:47.168577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 380/770] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:47.174578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:47.277991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7a72e-0758-40ce-8456-2224a5c269dc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:47.311632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684e7b4-13d1-4e5d-96ae-ebfb402e8cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:47.312245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684e7b4-13d1-4e5d-96ae-ebfb402e8cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:47.312523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684e7b4-13d1-4e5d-96ae-ebfb402e8cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:47.312790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684e7b4-13d1-4e5d-96ae-ebfb402e8cf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:47.313511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684e7b4-13d1-4e5d-96ae-ebfb402e8cf7 None admin] RBAC: Adding query filter params (interface=public, service_id=e09606069e49440aab7c8d663102ae74, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:47.313820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684e7b4-13d1-4e5d-96ae-ebfb402e8cf7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:47.315211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684e7b4-13d1-4e5d-96ae-ebfb402e8cf7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:47.320488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 391/771] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 01:59:47 2022] GET /identity/v3/endpoints?service_id=e09606069e49440aab7c8d663102ae74&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:47.326836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:47.430647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff941f-b923-4de7-83a9-4d6e4a29fa14 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:47.433789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:47.468907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed868735-4e81-45bc-b981-3d3ff7172795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:47.469575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868735-4e81-45bc-b981-3d3ff7172795 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:47.469854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868735-4e81-45bc-b981-3d3ff7172795 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:47.470124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868735-4e81-45bc-b981-3d3ff7172795 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:47.470722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed868735-4e81-45bc-b981-3d3ff7172795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:47.472075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed868735-4e81-45bc-b981-3d3ff7172795 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:47.485055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 381/772] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 01:59:47 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:59:48.289134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7657cb-17a7-4b39-8846-b02ef4ce1894 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:48.289640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7657cb-17a7-4b39-8846-b02ef4ce1894 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:48.289715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7657cb-17a7-4b39-8846-b02ef4ce1894 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:48.291128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 392/773] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:48.296802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ab6e-0a7c-418e-9ab2-02c0d784af67 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:48.297220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ab6e-0a7c-418e-9ab2-02c0d784af67 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:48.297377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ab6e-0a7c-418e-9ab2-02c0d784af67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:48.315512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6363ab6e-0a7c-418e-9ab2-02c0d784af67 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:48.316684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6363ab6e-0a7c-418e-9ab2-02c0d784af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:48.389086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 382/774] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:48 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:48.654452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7657cb-17a7-4b39-8846-b02ef4ce1894 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:48.697422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:48.761445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7657cb-17a7-4b39-8846-b02ef4ce1894 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:48.795509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d97c0-9a48-4b8c-afee-49597a416251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:48.796142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d97c0-9a48-4b8c-afee-49597a416251 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:48.796424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d97c0-9a48-4b8c-afee-49597a416251 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:48.796696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d97c0-9a48-4b8c-afee-49597a416251 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:48.797838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d97c0-9a48-4b8c-afee-49597a416251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:48.799292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d97c0-9a48-4b8c-afee-49597a416251 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:48.801030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 393/775] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:48.806670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ab6e-0a7c-418e-9ab2-02c0d784af67 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:48.905553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:48.909789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ab6e-0a7c-418e-9ab2-02c0d784af67 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:48.944354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fab6e-bda0-4696-b393-d07ae8b44fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:48.944956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fab6e-bda0-4696-b393-d07ae8b44fa9 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:48.945252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fab6e-bda0-4696-b393-d07ae8b44fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:48.945521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fab6e-bda0-4696-b393-d07ae8b44fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:48.946167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fab6e-bda0-4696-b393-d07ae8b44fa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:48.947561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fab6e-bda0-4696-b393-d07ae8b44fa9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:48.981045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 383/776] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 01:59:48 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:49.148888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbeaaf-538b-4837-9675-585da646de33 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:49.149229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbeaaf-538b-4837-9675-585da646de33 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:49.149432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbeaaf-538b-4837-9675-585da646de33 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:49.151504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 394/777] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:49.156268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f557e3-f0f5-469a-9991-5f8f5f825caa None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:49.156502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f557e3-f0f5-469a-9991-5f8f5f825caa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:49.156785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f557e3-f0f5-469a-9991-5f8f5f825caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:49.176869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-04f557e3-f0f5-469a-9991-5f8f5f825caa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:49.178094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-04f557e3-f0f5-469a-9991-5f8f5f825caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:49.247586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 384/778] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:49.513940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbeaaf-538b-4837-9675-585da646de33 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:49.621391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbeaaf-538b-4837-9675-585da646de33 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:49.628227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:49.656772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:49.657452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:49.657789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:49.658066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] PATH_INFO: `/v3/services/compute` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:49.658642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:49.660157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:49.661725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ebfb-a8b3-4137-baf5-d75dc2c315fb None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:49.662182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ebfb-a8b3-4137-baf5-d75dc2c315fb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:49.662182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ebfb-a8b3-4137-baf5-d75dc2c315fb None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:49.663568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 385/779] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:49.669128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186de3-32bf-46c6-a4a8-d01a5b752d09 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:49.669410 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186de3-32bf-46c6-a4a8-d01a5b752d09 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:49.669732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186de3-32bf-46c6-a4a8-d01a5b752d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:49.670672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:49.671637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 01:59:49.672497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:49.676512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 395/780] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:49.677623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:49.689510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1e186de3-32bf-46c6-a4a8-d01a5b752d09 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:49.690666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1e186de3-32bf-46c6-a4a8-d01a5b752d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:49.765242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 386/781] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:49.787803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e058b-f0f8-41d8-a962-3fdb9ac38fba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:49.822065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:49.822666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:49.822940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:49.823232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:49.823850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:49.824147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:49.825536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:49.834997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 396/782] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:49.836016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186de3-32bf-46c6-a4a8-d01a5b752d09 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:49.848150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:49.942437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186de3-32bf-46c6-a4a8-d01a5b752d09 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:49.976958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:49.977753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:49.978176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:49.978587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:49.979439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:49.979883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:49.981469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:49.986322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 387/783] 10.222.0.25 () {56 vars in 1112 bytes} [Sun Oct 23 01:59:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:49.991997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:50.028270 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:50.038732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:50.096313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f539b-f075-4c17-acd2-b8d98fddbe10 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:50.123758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:50.136839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:50.137482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:50.137756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:50.138020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:50.138687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:50.140040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:50.154978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ebfd7-68c3-493d-9ab8-8e3b2807475a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:50.161666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 397/784] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:59:50.207577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:50.208209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:50.208484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:50.208748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] PATH_INFO: `/v3/services/image` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:50.209347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:50.210709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:50.220282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:50.221702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 01:59:50.222593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:50.225388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 388/785] 10.222.0.25 () {56 vars in 1105 bytes} [Sun Oct 23 01:59:50 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:50.228064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:50.329211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:50.340823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f6ad1-7f20-44c2-9605-396f88b6dbd6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:50.376888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:50.377555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:50.377834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:50.378104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:50.378732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] RBAC: Adding query filter params (name=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:50.379032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:50.380384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:50.385540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 398/786] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:50.391139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:50.496667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e78294-b5dd-4e2d-91ec-a7e699d4016e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:50.531156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0e19-a4c1-4c15-a210-4c975d73fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:50.531760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0e19-a4c1-4c15-a210-4c975d73fb05 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:50.532033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0e19-a4c1-4c15-a210-4c975d73fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:50.532299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0e19-a4c1-4c15-a210-4c975d73fb05 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:50.532917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0e19-a4c1-4c15-a210-4c975d73fb05 None admin] RBAC: Adding query filter params (type=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:50.533245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0e19-a4c1-4c15-a210-4c975d73fb05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:50.534582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0e19-a4c1-4c15-a210-4c975d73fb05 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:50.535777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:50.542825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 389/787] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:50.546023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:50.646450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fcaac-3adb-47be-aaf3-5b1f1da0499d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:50.679671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a973-c11d-4278-836b-f02cd2c8f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:50.680276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a973-c11d-4278-836b-f02cd2c8f949 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:50.680552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a973-c11d-4278-836b-f02cd2c8f949 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:50.680821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a973-c11d-4278-836b-f02cd2c8f949 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:50.681515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2a973-c11d-4278-836b-f02cd2c8f949 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:50.682929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2a973-c11d-4278-836b-f02cd2c8f949 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:50.703734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 399/788] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 01:59:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:59:51.218315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daee4f-de52-4f6e-bbd7-c1f654bd0341 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:51.218869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daee4f-de52-4f6e-bbd7-c1f654bd0341 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:51.218869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daee4f-de52-4f6e-bbd7-c1f654bd0341 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:51.220241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 390/789] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:51.225685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ecf07-d494-406f-8e0c-831bc195fd18 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:51.225982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ecf07-d494-406f-8e0c-831bc195fd18 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:51.226260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ecf07-d494-406f-8e0c-831bc195fd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:51.244918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-199ecf07-d494-406f-8e0c-831bc195fd18 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:51.246135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-199ecf07-d494-406f-8e0c-831bc195fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:51.249696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:51.324863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 400/790] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:51.594694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daee4f-de52-4f6e-bbd7-c1f654bd0341 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:51.699448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daee4f-de52-4f6e-bbd7-c1f654bd0341 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:51.733444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12a68-f811-47af-8f98-7407caa56ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:51.734075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12a68-f811-47af-8f98-7407caa56ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:51.734354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12a68-f811-47af-8f98-7407caa56ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:51.734626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12a68-f811-47af-8f98-7407caa56ad8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:51.735726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12a68-f811-47af-8f98-7407caa56ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:51.737205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12a68-f811-47af-8f98-7407caa56ad8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:51.738938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 391/791] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:51.744427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ecf07-d494-406f-8e0c-831bc195fd18 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:51.846150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ecf07-d494-406f-8e0c-831bc195fd18 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:51.880449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6fcfb-9112-45fb-95ce-826f76b3b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:51.881089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6fcfb-9112-45fb-95ce-826f76b3b691 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:51.881367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6fcfb-9112-45fb-95ce-826f76b3b691 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:51.881640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6fcfb-9112-45fb-95ce-826f76b3b691 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:51.882300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6fcfb-9112-45fb-95ce-826f76b3b691 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:51.883745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6fcfb-9112-45fb-95ce-826f76b3b691 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:51.893402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:51.917002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 401/792] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 01:59:51 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:59:52.415707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb0b6-1cc2-4743-b348-f276d4f9e4cc None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:52.416190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb0b6-1cc2-4743-b348-f276d4f9e4cc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:52.416190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb0b6-1cc2-4743-b348-f276d4f9e4cc None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:52.417641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 392/793] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:52.422747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75117f63-728e-4b19-92ee-6a750ec27cae None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:52.423038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75117f63-728e-4b19-92ee-6a750ec27cae None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:52.423309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75117f63-728e-4b19-92ee-6a750ec27cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:52.442123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-75117f63-728e-4b19-92ee-6a750ec27cae None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:52.443311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75117f63-728e-4b19-92ee-6a750ec27cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:52.510696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 402/794] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:52.776846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb0b6-1cc2-4743-b348-f276d4f9e4cc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:52.849631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:52.886438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb0b6-1cc2-4743-b348-f276d4f9e4cc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:52.912936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4dfd5-17aa-40cf-a243-145859a36608 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:52.913459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4dfd5-17aa-40cf-a243-145859a36608 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:52.913540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4dfd5-17aa-40cf-a243-145859a36608 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:52.914866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 403/795] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:52.920174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d18b-9a87-4652-a047-6b8ee5123997 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:52.920453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d18b-9a87-4652-a047-6b8ee5123997 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:52.920723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d18b-9a87-4652-a047-6b8ee5123997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:52.921081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:52.921934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:52.922411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:52.922893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:52.934521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:52.938295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7c19d18b-9a87-4652-a047-6b8ee5123997 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:52.939464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c19d18b-9a87-4652-a047-6b8ee5123997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:52.940136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:52.941113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:52.941976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:52.942618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 393/796] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Oct 23 01:59:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:52.948120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.014809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 404/797] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:53.050465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9ba2e-b14e-4810-ba26-a0ca4c8e1ffd None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.076424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:53.085899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.086497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.086770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.087036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.087686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:53.087984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.089369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.101182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 394/798] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Oct 23 01:59:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:53.103701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19d18b-9a87-4652-a047-6b8ee5123997 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.157479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:53.206077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19d18b-9a87-4652-a047-6b8ee5123997 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.240629 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.241281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.241556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.241819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.251781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.253251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:53.267670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:53.268703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:53.269938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:53.269938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:53.269938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.273288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 405/799] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:53.274562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.283803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.379492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7935-9368-48cc-8f7b-a601cd443565 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.385172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81184269-b908-4188-ab64-0dcc21e202a2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.388339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:53.413116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.413714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.413989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.414255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.414885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:53.415182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.417061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.422366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.422985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.423267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.423542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.424335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.425724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.428943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 395/800] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:53.434491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.434785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 01:59:53.434785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:59:53.434785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [parameters: {'id': '20948941f417470ea8be0bf63bd10ef5', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 01:59:53.434785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:59:53.453885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 01:59:53.454737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:59:53.457885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:59:53.458788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:59:53.459664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:59:53.460447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'id': '20948941f417470ea8be0bf63bd10ef5', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 01:59:53.461619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:53.462633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.463798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 406/801] 10.222.0.25 () {60 vars in 1137 bytes} [Sun Oct 23 01:59:53 2022] POST /identity/v3/domains => generated 190 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:53.465602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.489037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:53.541122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5439-9bc8-4b40-9ef9-6e575a641382 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.575930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.576563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.576843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.576942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf8d5-d129-4727-b93e-187cc2c6f2be None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.577147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.585192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.586620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:53.598094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:53.599291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 396/802] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:53.605560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.621146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.621792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.622072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.622351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.633212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.634694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:53.651338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:53.652315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:53.653311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:53.653311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:53.653311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:53.653311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 407/803] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:53.658496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.680721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:53.718594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102ea8-6637-4fde-8960-5d5c2ac96cc5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.728556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:53.758405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.759109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.759449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.759787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.760115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4feedc-9740-460f-98c4-5ea19cfff39b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.760722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:53.761130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.763820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.785011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 397/804] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:53.790607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:53.795745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.796356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.796632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.796901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.797569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:53.797868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.799218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.811446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 408/805] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:53.899624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693ef04-2dc3-4a5d-87c2-d79911b65ae6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:53.936202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab612546-e887-4a79-91b0-72377e951dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:53.936849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612546-e887-4a79-91b0-72377e951dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:53.937155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612546-e887-4a79-91b0-72377e951dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:53.937418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612546-e887-4a79-91b0-72377e951dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:53.948591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab612546-e887-4a79-91b0-72377e951dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:53.950096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab612546-e887-4a79-91b0-72377e951dd6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ab612546-e887-4a79-91b0-72377e951dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:53.966297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:53.967352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:53.968275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:53.968275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:53.968275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:53.968275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 398/806] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:53.974738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:54.063899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.083956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61f2d-7f5d-4d90-932b-2a97b9765b66 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:54.109938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf5868-455c-4c7d-a468-b5d356236e39 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.110290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf5868-455c-4c7d-a468-b5d356236e39 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.110485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf5868-455c-4c7d-a468-b5d356236e39 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.111823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 399/807] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:54.117152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adc4d-fe9a-4b3d-9274-f37998cd14bf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.117435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adc4d-fe9a-4b3d-9274-f37998cd14bf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.117788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adc4d-fe9a-4b3d-9274-f37998cd14bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.123869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:54.124547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.124890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.125253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.125968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:54.126341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:54.127778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:54.139947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 409/808] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:54.140653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ec1adc4d-fe9a-4b3d-9274-f37998cd14bf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:54.141901 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ec1adc4d-fe9a-4b3d-9274-f37998cd14bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:54.145667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:54.156066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.210253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 400/809] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:54.244348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a9d7-04d5-4c36-af93-623b5bd42953 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:54.277313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:54.277939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.278220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.278493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.284957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:54.286431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:54.288856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:54.298335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:54.299378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:54.300405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 410/810] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:54.305332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adc4d-fe9a-4b3d-9274-f37998cd14bf None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:54.399987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adc4d-fe9a-4b3d-9274-f37998cd14bf None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:54.432711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:54.433310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.433536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.433801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.434472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:54.434768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:54.436165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:54.447063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 401/811] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:54.453935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:54.481428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:54.493546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.552840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dcdc7-aca9-47a8-8a5c-262b57152f88 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:54.581606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0838de1-ec86-4576-807a-b7b6f8c57ac8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:54.586827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:54.587548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.587884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.588296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/96fb635cda454c4a89badd09b8396ccf/roles/1b18e92eaa8e415eb14da2397a7cde68` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.590528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=96fb635cda454c4a89badd09b8396ccf, role_id=1b18e92eaa8e415eb14da2397a7cde68)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:54.591961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:54.605291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 411/812] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:54 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/96fb635cda454c4a89badd09b8396ccf/roles/1b18e92eaa8e415eb14da2397a7cde68 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:54.617493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:54.618144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.618419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.618684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.631448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:54.636493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:54.637645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:54.638892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 402/813] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:54.643995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:54.707290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.751456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1443b0-c3a5-4919-8349-d52335227af4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:54.786394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:54.787005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.787283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.787557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.788217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:54.788521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:54.789918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:54.798964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 412/814] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:54.804831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:54.868929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:54.903063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274213f-74ff-4e92-8be9-d84c60ecb430 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:54.934702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:54.935318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:54.935590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:54.935857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] PATH_INFO: `/v3/users/cdbbcfe1a8ee43feb7b51e6c27dfdef6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:54.949197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] RBAC: Authorizing `identity:get_user(user_id=cdbbcfe1a8ee43feb7b51e6c27dfdef6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:54.950630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:54.952441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 403/815] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:59:54 2022] GET /identity/v3/users/cdbbcfe1a8ee43feb7b51e6c27dfdef6 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:54.958004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:55.054214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514aab8-0f94-41ae-8ecf-f68dc1fff28a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:55.077569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:55.090025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd8eaa-cef9-4969-8474-fb7833483119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:55.090660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd8eaa-cef9-4969-8474-fb7833483119 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:55.090937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd8eaa-cef9-4969-8474-fb7833483119 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:55.091209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd8eaa-cef9-4969-8474-fb7833483119 None admin] PATH_INFO: `/v3/projects/3d91ad7540c6427fb9a7753a60e5861a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:55.092314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd8eaa-cef9-4969-8474-fb7833483119 None admin] RBAC: Authorizing `identity:get_project(project_id=3d91ad7540c6427fb9a7753a60e5861a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:55.093775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd8eaa-cef9-4969-8474-fb7833483119 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:55.095404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 413/816] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:59:54 2022] GET /identity/v3/projects/3d91ad7540c6427fb9a7753a60e5861a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:55.101736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:55.199716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ee6c-76f7-40d5-bdda-e65ed8f3254e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:55.224818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:55.234590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeed792-a76c-477e-8519-ce08e054dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:55.235247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeed792-a76c-477e-8519-ce08e054dec6 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:55.235524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeed792-a76c-477e-8519-ce08e054dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:55.235791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeed792-a76c-477e-8519-ce08e054dec6 None admin] PATH_INFO: `/v3/projects/3d91ad7540c6427fb9a7753a60e5861a/users/cdbbcfe1a8ee43feb7b51e6c27dfdef6/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:55.237664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeed792-a76c-477e-8519-ce08e054dec6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d91ad7540c6427fb9a7753a60e5861a, user_id=cdbbcfe1a8ee43feb7b51e6c27dfdef6, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:55.239060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeed792-a76c-477e-8519-ce08e054dec6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:55.251464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 404/817] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 01:59:55 2022] PUT /identity/v3/projects/3d91ad7540c6427fb9a7753a60e5861a/users/cdbbcfe1a8ee43feb7b51e6c27dfdef6/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:59:56.752067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cd1f4-2dc7-437a-941b-5b811e20a0c8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:56.752697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cd1f4-2dc7-437a-941b-5b811e20a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:56.752697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cd1f4-2dc7-437a-941b-5b811e20a0c8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:56.755772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 414/818] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:59:56.759417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205953-0b4b-466f-bc68-29d12e9fbb13 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:56.759847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205953-0b4b-466f-bc68-29d12e9fbb13 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:56.759944 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205953-0b4b-466f-bc68-29d12e9fbb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:56.778312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-73205953-0b4b-466f-bc68-29d12e9fbb13 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:56.779489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73205953-0b4b-466f-bc68-29d12e9fbb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:56.844528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 405/819] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:59:57.116703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cd1f4-2dc7-437a-941b-5b811e20a0c8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.215449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cd1f4-2dc7-437a-941b-5b811e20a0c8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:57.251679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5d195-e501-44b9-87f2-1c96af646324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:57.252336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d195-e501-44b9-87f2-1c96af646324 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.252618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d195-e501-44b9-87f2-1c96af646324 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.252893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d195-e501-44b9-87f2-1c96af646324 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.265069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5d195-e501-44b9-87f2-1c96af646324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-acc5d195-e501-44b9-87f2-1c96af646324 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:57.269985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:57.273117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:57.274295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 415/820] 10.222.0.25 () {56 vars in 1120 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:57.277734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73205953-0b4b-466f-bc68-29d12e9fbb13 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.351392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955e56-0136-417b-8c92-b260edd88eef None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.351748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955e56-0136-417b-8c92-b260edd88eef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.351957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955e56-0136-417b-8c92-b260edd88eef None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.353886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 416/821] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 01:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:59:57.358883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889327f-5acf-40fb-ae3f-6c283d47a6d1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.359167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889327f-5acf-40fb-ae3f-6c283d47a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.359446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889327f-5acf-40fb-ae3f-6c283d47a6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.373853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73205953-0b4b-466f-bc68-29d12e9fbb13 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:57.376811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c889327f-5acf-40fb-ae3f-6c283d47a6d1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:57.378029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c889327f-5acf-40fb-ae3f-6c283d47a6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:57.390304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:57.409042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:57.409647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.409927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.410190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.410837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:57.411135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:57.412489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:57.420296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 406/822] 10.222.0.25 () {56 vars in 1115 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:57.424162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:57.426176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.445481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 417/823] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 01:59:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 01:59:57.521582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc73aa-983f-4093-a3c2-b8d865032a64 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:57.552693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:57.553335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.553615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.553875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.564341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:57.565776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:57.579877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:57.580913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:57.581861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:57.581861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:57.581861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:57.581861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 407/824] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:59:57.586775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889327f-5acf-40fb-ae3f-6c283d47a6d1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.681471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889327f-5acf-40fb-ae3f-6c283d47a6d1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:57.714694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.717742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:57.718532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.718911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.719193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.720199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:57.720507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:57.722518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:57.734751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 418/825] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:57.740272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.750781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:57.781550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:57.821330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4af140-d2ba-4f83-9f1a-c96358bca6f2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:57.838196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1f42-a1ca-4a1b-a0ed-bb2be01373d2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:57.854244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:57.854868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.855142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.855405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.865085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 01:59:57.870356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:57.871354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 01:59:57.872288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 01:59:57.873017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:57.873124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 408/826] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:57.873593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:57.873805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:57.874069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:57.877427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.881758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:57.883182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:59:57.894618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:57.895740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:57.896733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 419/827] 10.222.0.25 () {56 vars in 1093 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:57.901441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:57.966131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:57.975967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e06b7a-8704-428e-a919-3a90e847cad1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:57.997989 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.000834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee99b3-98a7-48db-bd9b-1c98490ebf3e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.009861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.010467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.010744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.011014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.011668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:58.011966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.013407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.021682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 409/828] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:58.027482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.033708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.034308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.034588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.034859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.035581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:58.035895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.037318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.054591 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 420/829] 10.222.0.25 () {56 vars in 1133 bytes} [Sun Oct 23 01:59:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:58.060229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.136090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6ddab-d51b-40b0-8eba-687c5fe8dc56 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.156272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153ce4-9423-4327-9c6c-5427a7584c18 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.169904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.170523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.170796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.171064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] PATH_INFO: `/v3/users/cdbbcfe1a8ee43feb7b51e6c27dfdef6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.172169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] RBAC: Authorizing `identity:get_user(user_id=cdbbcfe1a8ee43feb7b51e6c27dfdef6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.173618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.175173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 410/830] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/users/cdbbcfe1a8ee43feb7b51e6c27dfdef6 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:58.180806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.189691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.190288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.190560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.190824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.202229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.217323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.258034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.259502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.278762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030e9d8-0a13-4357-bd26-9fb0b2ed5d23 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.312099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.312686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.312960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.313251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.354905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 421/831] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 01:59:58.360551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.379520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.380962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.401165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.418603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.458505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94026cdc-a758-4e61-8515-aadaa374aa03 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.478751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 411/832] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 01:59:58.485128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.494164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.495334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.495614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.495886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.505996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.507452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:59:58.522396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:58.523356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 01:59:58.524391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:59:58.524391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 01:59:58.524391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:58.524391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 422/833] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:58.530958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.584706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226b0d-6558-462d-a86e-7f2a707fe8b4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.604502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.618886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.620069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.620347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.620616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] PATH_INFO: `/v3/projects/3d91ad7540c6427fb9a7753a60e5861a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.621800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] RBAC: Authorizing `identity:get_project(project_id=3d91ad7540c6427fb9a7753a60e5861a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.623237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.625234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 412/834] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/projects/3d91ad7540c6427fb9a7753a60e5861a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:58.630858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.634782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16b12-05e4-4c10-909e-f5a2cca119ed None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.645063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.669234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.669837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.670114 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.670387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.671021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:58.671344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.672708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.688646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 423/835] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:58.689838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.733558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bafce-b57c-4afe-b0a1-5fc4fc61782a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.767844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.768438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.768716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.769002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.769722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=3d91ad7540c6427fb9a7753a60e5861a, user.id=cdbbcfe1a8ee43feb7b51e6c27dfdef6) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:58.770027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.771467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.777719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 413/836] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/role_assignments?user.id=cdbbcfe1a8ee43feb7b51e6c27dfdef6&scope.project.id=3d91ad7540c6427fb9a7753a60e5861a&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:59:58.788944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db6e5-1c49-468a-b0fb-218ed08cb413 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.826670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.827323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.827599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.827865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:58.835753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:58.837275 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 01:59:58.850244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:59:58.851492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 01:59:58.852607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 01:59:58.856378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 424/837] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 01:59:58.857719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:58.914240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:58.965225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48f5-f1da-4cab-8a83-d0f18c6318a6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:58.998615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba360-5246-4545-9ee2-8f06c97861dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:58.999156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba360-5246-4545-9ee2-8f06c97861dd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:58.999437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba360-5246-4545-9ee2-8f06c97861dd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:58.999705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba360-5246-4545-9ee2-8f06c97861dd None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:59.000384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba360-5246-4545-9ee2-8f06c97861dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:59.000688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba360-5246-4545-9ee2-8f06c97861dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:59.002127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba360-5246-4545-9ee2-8f06c97861dd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:59.013851 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 414/838] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 01:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:59:59.020059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:59.050224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:59.120079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf976f-f450-456a-a301-bf9979968e31 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:59.152926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd393cbe-2fc8-4a00-8f0e-adb8d44bfeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:59.153550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393cbe-2fc8-4a00-8f0e-adb8d44bfeee None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:59.153826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393cbe-2fc8-4a00-8f0e-adb8d44bfeee None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:59.154093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393cbe-2fc8-4a00-8f0e-adb8d44bfeee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:59.154805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd393cbe-2fc8-4a00-8f0e-adb8d44bfeee None admin] RBAC: Adding query filter params (role.id=1b18e92eaa8e415eb14da2397a7cde68, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=96fb635cda454c4a89badd09b8396ccf) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:59:59.155109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd393cbe-2fc8-4a00-8f0e-adb8d44bfeee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:59.156537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd393cbe-2fc8-4a00-8f0e-adb8d44bfeee None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:59.162141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 425/839] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 01:59:59 2022] GET /identity/v3/role_assignments?user.id=96fb635cda454c4a89badd09b8396ccf&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=1b18e92eaa8e415eb14da2397a7cde68 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:00.909174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b8b9-6ca3-46d9-b431-15b4cb793be4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:00.909732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b8b9-6ca3-46d9-b431-15b4cb793be4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:00.909732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b8b9-6ca3-46d9-b431-15b4cb793be4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:00.911048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 415/840] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:00.916789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462d95b-4a31-44de-a373-f95207a1efaf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:00.917245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462d95b-4a31-44de-a373-f95207a1efaf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:00.917362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462d95b-4a31-44de-a373-f95207a1efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:00.935556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a462d95b-4a31-44de-a373-f95207a1efaf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:00.936724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a462d95b-4a31-44de-a373-f95207a1efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:01.001430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 426/841] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:01.267456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b8b9-6ca3-46d9-b431-15b4cb793be4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:01.365142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b8b9-6ca3-46d9-b431-15b4cb793be4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:01.377576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:01.397731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ece98-488a-4dc4-ab23-be616e8b2a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:01.398343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ece98-488a-4dc4-ab23-be616e8b2a00 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:01.398620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ece98-488a-4dc4-ab23-be616e8b2a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:01.398890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ece98-488a-4dc4-ab23-be616e8b2a00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:01.399970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ece98-488a-4dc4-ab23-be616e8b2a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:01.401920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ece98-488a-4dc4-ab23-be616e8b2a00 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:01.403450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 416/842] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:00:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:01.409124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462d95b-4a31-44de-a373-f95207a1efaf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:01.432997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:01.620483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462d95b-4a31-44de-a373-f95207a1efaf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:01.653260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf79c5-a779-4782-ba3c-66fc0f261789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:01.653852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf79c5-a779-4782-ba3c-66fc0f261789 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:01.654128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf79c5-a779-4782-ba3c-66fc0f261789 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:01.654399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf79c5-a779-4782-ba3c-66fc0f261789 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:01.655039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf79c5-a779-4782-ba3c-66fc0f261789 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:01.656459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf79c5-a779-4782-ba3c-66fc0f261789 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:01.676875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 427/843] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 02:00:01 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:00:03.814533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c98c4-1c89-43ce-9ef6-0519d1d2f907 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:03.815090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c98c4-1c89-43ce-9ef6-0519d1d2f907 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:03.815090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c98c4-1c89-43ce-9ef6-0519d1d2f907 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:03.816401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 417/844] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:03.821462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a018f0-a315-4655-8fbf-bb05d84af51c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:03.821860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a018f0-a315-4655-8fbf-bb05d84af51c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:03.821996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a018f0-a315-4655-8fbf-bb05d84af51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:03.840195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f6a018f0-a315-4655-8fbf-bb05d84af51c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:03.841402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f6a018f0-a315-4655-8fbf-bb05d84af51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:03.904882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 428/845] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:04.170001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c98c4-1c89-43ce-9ef6-0519d1d2f907 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:04.266784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c98c4-1c89-43ce-9ef6-0519d1d2f907 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:04.299374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:04.300011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:04.300284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:04.300550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] PATH_INFO: `/v3/roles/04c3574945c544d08b9e6b4c7ad69561` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:04.301996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] RBAC: Authorizing `identity:get_role(role_id=04c3574945c544d08b9e6b4c7ad69561)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:04.303364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:04.304652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 418/846] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:04 2022] GET /identity/v3/roles/04c3574945c544d08b9e6b4c7ad69561 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:04.310245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a018f0-a315-4655-8fbf-bb05d84af51c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:04.321365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:04.406382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a018f0-a315-4655-8fbf-bb05d84af51c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:04.438254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:04.438864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:04.439138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:04.439405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] PATH_INFO: `/v3/users/98ab65a6eaff40dfb9847041a65455a6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:04.451677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] RBAC: Authorizing `identity:get_user(user_id=98ab65a6eaff40dfb9847041a65455a6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:04.453125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:04.454659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 429/847] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:04 2022] GET /identity/v3/users/98ab65a6eaff40dfb9847041a65455a6 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:04.460192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:04.508044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:04.556930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5319a3-6cfa-45fc-b933-b57670f1873f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:04.590716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357f3d-ff50-4674-afb7-d1e6288c7736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:04.591332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357f3d-ff50-4674-afb7-d1e6288c7736 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:04.591606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357f3d-ff50-4674-afb7-d1e6288c7736 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:04.591873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357f3d-ff50-4674-afb7-d1e6288c7736 None admin] PATH_INFO: `/v3/projects/3d91ad7540c6427fb9a7753a60e5861a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:04.592963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357f3d-ff50-4674-afb7-d1e6288c7736 None admin] RBAC: Authorizing `identity:get_project(project_id=3d91ad7540c6427fb9a7753a60e5861a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:04.594410 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357f3d-ff50-4674-afb7-d1e6288c7736 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:04.595993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 419/848] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 02:00:04 2022] GET /identity/v3/projects/3d91ad7540c6427fb9a7753a60e5861a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:04.602433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:04.665322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:04.696621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdf74f-c8c3-4600-82af-7bea109087ab None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:04.730169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9c9c-84fd-4acc-8e76-93b030695e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:04.730815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9c9c-84fd-4acc-8e76-93b030695e8e None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:04.731090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9c9c-84fd-4acc-8e76-93b030695e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:04.731355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9c9c-84fd-4acc-8e76-93b030695e8e None admin] PATH_INFO: `/v3/projects/3d91ad7540c6427fb9a7753a60e5861a/users/98ab65a6eaff40dfb9847041a65455a6/roles/04c3574945c544d08b9e6b4c7ad69561` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:04.733439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9c9c-84fd-4acc-8e76-93b030695e8e None admin] RBAC: Authorizing `identity:create_grant(project_id=3d91ad7540c6427fb9a7753a60e5861a, user_id=98ab65a6eaff40dfb9847041a65455a6, role_id=04c3574945c544d08b9e6b4c7ad69561)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:04.734854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9c9c-84fd-4acc-8e76-93b030695e8e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:04.747164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 430/849] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 02:00:04 2022] PUT /identity/v3/projects/3d91ad7540c6427fb9a7753a60e5861a/users/98ab65a6eaff40dfb9847041a65455a6/roles/04c3574945c544d08b9e6b4c7ad69561 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:00:06.842379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ffb83-8fb1-4e32-9bc0-d2641c3def7d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:06.842932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ffb83-8fb1-4e32-9bc0-d2641c3def7d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:06.842932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ffb83-8fb1-4e32-9bc0-d2641c3def7d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:06.844227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 420/850] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:06.849617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf382-416c-4d70-9b56-fb4b5a5e747b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:06.850033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf382-416c-4d70-9b56-fb4b5a5e747b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:06.850163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf382-416c-4d70-9b56-fb4b5a5e747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:06.868156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3fbaf382-416c-4d70-9b56-fb4b5a5e747b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:06.869931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3fbaf382-416c-4d70-9b56-fb4b5a5e747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:06.932407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 431/851] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 02:00:07.195299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ffb83-8fb1-4e32-9bc0-d2641c3def7d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:07.292771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ffb83-8fb1-4e32-9bc0-d2641c3def7d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:07.308322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:07.325545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:07.326153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:07.326756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:07.327026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] PATH_INFO: `/v3/roles/04c3574945c544d08b9e6b4c7ad69561` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:07.328359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] RBAC: Authorizing `identity:get_role(role_id=04c3574945c544d08b9e6b4c7ad69561)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:07.329724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:07.331010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 421/852] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:07 2022] GET /identity/v3/roles/04c3574945c544d08b9e6b4c7ad69561 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:07.336715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf382-416c-4d70-9b56-fb4b5a5e747b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:07.392644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:07.432751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf382-416c-4d70-9b56-fb4b5a5e747b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:07.464605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:07.465241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:07.465518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:07.465788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] PATH_INFO: `/v3/users/98ab65a6eaff40dfb9847041a65455a6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:07.466872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] RBAC: Authorizing `identity:get_user(user_id=98ab65a6eaff40dfb9847041a65455a6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:07.468287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:07.469827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 432/853] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:07 2022] GET /identity/v3/users/98ab65a6eaff40dfb9847041a65455a6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:07.475652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:07.569708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da028346-2cad-429b-b394-02f61ca68cf4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:07.602795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:07.603399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:07.603671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:07.603936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:07.652737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:07.667964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:07.669413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:07.763648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 422/854] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 02:00:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 02:00:07.769783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:07.865320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e08e9-f7d0-4f9a-9812-bd9a214e6606 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:07.889831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:07.898237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319fea2-3cbf-4c3f-905e-b2d98b4f1852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:07.898848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319fea2-3cbf-4c3f-905e-b2d98b4f1852 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:07.899123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319fea2-3cbf-4c3f-905e-b2d98b4f1852 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:07.899394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319fea2-3cbf-4c3f-905e-b2d98b4f1852 None admin] PATH_INFO: `/v3/projects/3d91ad7540c6427fb9a7753a60e5861a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:07.901074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319fea2-3cbf-4c3f-905e-b2d98b4f1852 None admin] RBAC: Authorizing `identity:get_project(project_id=3d91ad7540c6427fb9a7753a60e5861a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:07.902483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319fea2-3cbf-4c3f-905e-b2d98b4f1852 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:07.904099 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 433/855] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 02:00:07 2022] GET /identity/v3/projects/3d91ad7540c6427fb9a7753a60e5861a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:07.910213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:07.990053 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:08.006062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754aa3-695c-4e66-89aa-3aa495f68a07 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:08.038722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd3c6-9156-430e-846e-edf5ae702134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:08.039311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd3c6-9156-430e-846e-edf5ae702134 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:08.039588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd3c6-9156-430e-846e-edf5ae702134 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:08.039857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd3c6-9156-430e-846e-edf5ae702134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:08.040564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd3c6-9156-430e-846e-edf5ae702134 None admin] RBAC: Adding query filter params (role.id=04c3574945c544d08b9e6b4c7ad69561, scope.project.id=3d91ad7540c6427fb9a7753a60e5861a, user.id=98ab65a6eaff40dfb9847041a65455a6) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:00:08.040868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd3c6-9156-430e-846e-edf5ae702134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:08.042307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd3c6-9156-430e-846e-edf5ae702134 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:08.047871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 423/856] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 02:00:07 2022] GET /identity/v3/role_assignments?user.id=98ab65a6eaff40dfb9847041a65455a6&scope.project.id=3d91ad7540c6427fb9a7753a60e5861a&role.id=04c3574945c544d08b9e6b4c7ad69561 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:10.144150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42bd03-32d1-4982-b13a-e2e8a99797d8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:10.144555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42bd03-32d1-4982-b13a-e2e8a99797d8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:10.144690 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42bd03-32d1-4982-b13a-e2e8a99797d8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:10.146031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 434/857] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:10.151337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a356-8553-40a9-a4bb-c4fc3ebb9247 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:10.151757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a356-8553-40a9-a4bb-c4fc3ebb9247 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:10.151910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a356-8553-40a9-a4bb-c4fc3ebb9247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:10.170167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1849a356-8553-40a9-a4bb-c4fc3ebb9247 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:10.171333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1849a356-8553-40a9-a4bb-c4fc3ebb9247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:10.235141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 424/858] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:10.496844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42bd03-32d1-4982-b13a-e2e8a99797d8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:10.592833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42bd03-32d1-4982-b13a-e2e8a99797d8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:10.625223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b6074-5383-489d-ab49-daad90e07bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:10.625832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6074-5383-489d-ab49-daad90e07bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:10.626106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6074-5383-489d-ab49-daad90e07bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:10.626370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6074-5383-489d-ab49-daad90e07bc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:10.627451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b6074-5383-489d-ab49-daad90e07bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:10.628852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b6074-5383-489d-ab49-daad90e07bc8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:10.630402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 435/859] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:00:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:10.636647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a356-8553-40a9-a4bb-c4fc3ebb9247 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:10.711216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:10.732951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a356-8553-40a9-a4bb-c4fc3ebb9247 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:10.878991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735f76b-f550-4dea-af3a-f762a686631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:10.879495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f76b-f550-4dea-af3a-f762a686631a None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:10.879771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f76b-f550-4dea-af3a-f762a686631a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:10.880037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f76b-f550-4dea-af3a-f762a686631a None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:10.880678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735f76b-f550-4dea-af3a-f762a686631a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:10.882099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735f76b-f550-4dea-af3a-f762a686631a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:10.907383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 425/860] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 02:00:10 2022] POST /identity/v3/projects => generated 311 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:00:13.043283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80c3e-6668-4ab1-8309-02669a4ba8ce None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:13.043835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80c3e-6668-4ab1-8309-02669a4ba8ce None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:13.043835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80c3e-6668-4ab1-8309-02669a4ba8ce None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:13.045180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 436/861] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:13.050468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4c53-da01-4d20-8032-55430122fdb9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:13.050848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4c53-da01-4d20-8032-55430122fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:13.051010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4c53-da01-4d20-8032-55430122fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:13.069133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3dea4c53-da01-4d20-8032-55430122fdb9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:13.070334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3dea4c53-da01-4d20-8032-55430122fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:13.134687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 426/862] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:13.402136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc80c3e-6668-4ab1-8309-02669a4ba8ce None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:13.460961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:13.499153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc80c3e-6668-4ab1-8309-02669a4ba8ce None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:13.531215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888db5c0-0801-43d4-af53-ae4325f37a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:13.531829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db5c0-0801-43d4-af53-ae4325f37a91 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:13.532105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db5c0-0801-43d4-af53-ae4325f37a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:13.532372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db5c0-0801-43d4-af53-ae4325f37a91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:13.533494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888db5c0-0801-43d4-af53-ae4325f37a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:13.534908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888db5c0-0801-43d4-af53-ae4325f37a91 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:13.536431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 437/863] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:00:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:13.542701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4c53-da01-4d20-8032-55430122fdb9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:13.598375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:13.637249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4c53-da01-4d20-8032-55430122fdb9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:13.669365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ca602-ec1a-4c5f-a1f0-7221dfe82535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:13.669900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca602-ec1a-4c5f-a1f0-7221dfe82535 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:13.670177 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca602-ec1a-4c5f-a1f0-7221dfe82535 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:13.670447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca602-ec1a-4c5f-a1f0-7221dfe82535 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:13.671092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ca602-ec1a-4c5f-a1f0-7221dfe82535 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:13.672493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ca602-ec1a-4c5f-a1f0-7221dfe82535 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:13.692903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 427/864] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 02:00:13 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:00:15.850237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1518a-82b8-4333-aebe-503a28802221 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:15.850828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1518a-82b8-4333-aebe-503a28802221 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:15.850828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1518a-82b8-4333-aebe-503a28802221 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:15.852082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 438/865] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:15.857706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5a6c-3261-4a24-a8d1-06d652ba5efa None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:15.858108 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5a6c-3261-4a24-a8d1-06d652ba5efa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:15.858256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5a6c-3261-4a24-a8d1-06d652ba5efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:15.876426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-97cf5a6c-3261-4a24-a8d1-06d652ba5efa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:15.877629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-97cf5a6c-3261-4a24-a8d1-06d652ba5efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:15.942163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 428/866] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:16.206641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1518a-82b8-4333-aebe-503a28802221 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:16.304001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1518a-82b8-4333-aebe-503a28802221 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:16.331934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:16.337856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:16.338475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:16.338752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:16.339022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:16.349041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:00:16.353850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:00:16.354784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:00:16.355705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 439/867] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 02:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:00:16.360733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5a6c-3261-4a24-a8d1-06d652ba5efa None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:16.404967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:16.455369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5a6c-3261-4a24-a8d1-06d652ba5efa None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:16.488276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:16.488871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:16.489177 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:16.489448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:16.490104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:00:16.490405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:16.491750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:16.499467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 429/868] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 02:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:16.505642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:16.600374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750be31f-8748-41d5-9d76-823580672a42 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:16.632517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:16.633155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:16.633431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:16.633701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] PATH_INFO: `/v3/users/16adf7a9af7848128eb2779902ea9f84` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:16.646524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] RBAC: Authorizing `identity:get_user(user_id=16adf7a9af7848128eb2779902ea9f84)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:16.647948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:16.649540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 440/869] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:16 2022] GET /identity/v3/users/16adf7a9af7848128eb2779902ea9f84 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:16.655797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:16.749657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31763fd-3f26-4193-b730-68c33d8e8e8f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:16.757968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:16.782934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1954f3-2896-4403-8b01-59ea02eee162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:16.783551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1954f3-2896-4403-8b01-59ea02eee162 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:16.783825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1954f3-2896-4403-8b01-59ea02eee162 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:16.784094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1954f3-2896-4403-8b01-59ea02eee162 None admin] PATH_INFO: `/v3/projects/f98187b32fcf43349f3bebc8d0414957` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:16.785214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1954f3-2896-4403-8b01-59ea02eee162 None admin] RBAC: Authorizing `identity:get_project(project_id=f98187b32fcf43349f3bebc8d0414957)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:16.786623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1954f3-2896-4403-8b01-59ea02eee162 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:16.788209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 430/870] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 02:00:16 2022] GET /identity/v3/projects/f98187b32fcf43349f3bebc8d0414957 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:16.793962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:16.841049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:16.888882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dee8d-e236-48a3-a9d8-3773ae2f78c1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:16.921525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9d18-cbd5-4efb-9dc1-aa45bc31eb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:16.922111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9d18-cbd5-4efb-9dc1-aa45bc31eb02 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:16.922388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9d18-cbd5-4efb-9dc1-aa45bc31eb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:16.922656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9d18-cbd5-4efb-9dc1-aa45bc31eb02 None admin] PATH_INFO: `/v3/projects/f98187b32fcf43349f3bebc8d0414957/users/16adf7a9af7848128eb2779902ea9f84/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:16.924485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b9d18-cbd5-4efb-9dc1-aa45bc31eb02 None admin] RBAC: Authorizing `identity:create_grant(project_id=f98187b32fcf43349f3bebc8d0414957, user_id=16adf7a9af7848128eb2779902ea9f84, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:16.925941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b9d18-cbd5-4efb-9dc1-aa45bc31eb02 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:16.938361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 441/871] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 02:00:16 2022] PUT /identity/v3/projects/f98187b32fcf43349f3bebc8d0414957/users/16adf7a9af7848128eb2779902ea9f84/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:00:19.027756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904283a-cade-4cc4-b91f-43d58708ad4a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:19.028280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904283a-cade-4cc4-b91f-43d58708ad4a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:19.028280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904283a-cade-4cc4-b91f-43d58708ad4a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:19.029647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 431/872] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:19.034870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114683d-7c57-408c-b6ee-8fe522ad579a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:19.035290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114683d-7c57-408c-b6ee-8fe522ad579a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:19.035400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114683d-7c57-408c-b6ee-8fe522ad579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:19.053463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0114683d-7c57-408c-b6ee-8fe522ad579a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:19.054616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0114683d-7c57-408c-b6ee-8fe522ad579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:19.118332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 442/873] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:19.387666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904283a-cade-4cc4-b91f-43d58708ad4a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:19.485170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904283a-cade-4cc4-b91f-43d58708ad4a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:19.517353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:19.517954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:19.518230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:19.518497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:19.528502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:00:19.533257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:00:19.534324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:00:19.535463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 432/874] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 02:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:00:19.540113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114683d-7c57-408c-b6ee-8fe522ad579a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:19.578416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:19.636729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114683d-7c57-408c-b6ee-8fe522ad579a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:19.668574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:19.669146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:19.669425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:19.669690 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:19.670347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:00:19.670645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:19.671995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:19.679547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 443/875] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 02:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:19.685460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:19.720331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:19.782176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b16349-157c-4db0-aba8-7767358cd7a0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:19.813342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:19.813951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:19.814228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:19.814499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] PATH_INFO: `/v3/users/16adf7a9af7848128eb2779902ea9f84` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:19.815607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] RBAC: Authorizing `identity:get_user(user_id=16adf7a9af7848128eb2779902ea9f84)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:19.817041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:19.818571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 433/876] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:19 2022] GET /identity/v3/users/16adf7a9af7848128eb2779902ea9f84 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:19.825293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:19.919038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:19.922030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6a48c-5210-4038-90e8-9e9459ef87cb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:19.955446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:19.956047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:19.956332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:19.956606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:20.021321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:20.022761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:20.113872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:20.121454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 444/877] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 02:00:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 02:00:20.123778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:20.218158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26a6e9-cc85-4b6e-b3a9-5c74adba805a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:20.220382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:20.250736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03ef6f-9513-4c7f-b40d-7006e68ef018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:20.251347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03ef6f-9513-4c7f-b40d-7006e68ef018 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:20.251620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03ef6f-9513-4c7f-b40d-7006e68ef018 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:20.251884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03ef6f-9513-4c7f-b40d-7006e68ef018 None admin] PATH_INFO: `/v3/projects/f98187b32fcf43349f3bebc8d0414957` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:20.252959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03ef6f-9513-4c7f-b40d-7006e68ef018 None admin] RBAC: Authorizing `identity:get_project(project_id=f98187b32fcf43349f3bebc8d0414957)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:20.254383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03ef6f-9513-4c7f-b40d-7006e68ef018 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:20.255950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 434/878] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 02:00:20 2022] GET /identity/v3/projects/f98187b32fcf43349f3bebc8d0414957 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:20.262421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:20.356518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e170b-7a12-40e7-9601-e1fe12306836 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:20.389381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f388f-8143-4d65-9beb-49ac80fd60e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:20.389974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f388f-8143-4d65-9beb-49ac80fd60e8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:20.390255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f388f-8143-4d65-9beb-49ac80fd60e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:20.390526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f388f-8143-4d65-9beb-49ac80fd60e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:20.391255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f388f-8143-4d65-9beb-49ac80fd60e8 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=f98187b32fcf43349f3bebc8d0414957, user.id=16adf7a9af7848128eb2779902ea9f84) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:00:20.391563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f388f-8143-4d65-9beb-49ac80fd60e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:20.393004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f388f-8143-4d65-9beb-49ac80fd60e8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:20.398587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 445/879] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 02:00:20 2022] GET /identity/v3/role_assignments?user.id=16adf7a9af7848128eb2779902ea9f84&scope.project.id=f98187b32fcf43349f3bebc8d0414957&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:22.518557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3cc83-84eb-456e-9a37-56f22d9bb1f4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:22.519081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3cc83-84eb-456e-9a37-56f22d9bb1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:22.519081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3cc83-84eb-456e-9a37-56f22d9bb1f4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:22.520423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 435/880] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:22.525999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105523-dca6-4853-afc0-77ae294bf7a0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:22.526396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105523-dca6-4853-afc0-77ae294bf7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:22.526539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28105523-dca6-4853-afc0-77ae294bf7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:22.544696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-28105523-dca6-4853-afc0-77ae294bf7a0 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:22.545901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-28105523-dca6-4853-afc0-77ae294bf7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:22.601709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:22.610452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 446/881] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:22.875935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3cc83-84eb-456e-9a37-56f22d9bb1f4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:22.974063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3cc83-84eb-456e-9a37-56f22d9bb1f4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:23.005811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a06a0-9613-4715-a6ce-d945248f5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:23.006399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a06a0-9613-4715-a6ce-d945248f5508 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:23.006674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a06a0-9613-4715-a6ce-d945248f5508 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:23.006943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a06a0-9613-4715-a6ce-d945248f5508 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:23.007601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a06a0-9613-4715-a6ce-d945248f5508 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:23.009502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a06a0-9613-4715-a6ce-d945248f5508 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:23.024569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 436/882] 10.222.0.25 () {60 vars in 1138 bytes} [Sun Oct 23 02:00:22 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:00:25.166157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c82fef-62ae-4008-9a8d-692715cfe2f1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:25.166605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c82fef-62ae-4008-9a8d-692715cfe2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:25.166691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c82fef-62ae-4008-9a8d-692715cfe2f1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:25.168014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 447/883] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:25.173440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35315ae-7501-4259-b4c4-98133ff5f653 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:25.173857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35315ae-7501-4259-b4c4-98133ff5f653 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:25.173993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35315ae-7501-4259-b4c4-98133ff5f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:25.191590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a35315ae-7501-4259-b4c4-98133ff5f653 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:25.192741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a35315ae-7501-4259-b4c4-98133ff5f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:25.217287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:25.256815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 437/884] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:25.525108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c82fef-62ae-4008-9a8d-692715cfe2f1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:25.621761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c82fef-62ae-4008-9a8d-692715cfe2f1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:25.654376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0c7d2-f9af-446a-8785-88afac1a5571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:25.654982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c7d2-f9af-446a-8785-88afac1a5571 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:25.655257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c7d2-f9af-446a-8785-88afac1a5571 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:25.655527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c7d2-f9af-446a-8785-88afac1a5571 None admin] PATH_INFO: `/v3/domains/982c0dd647db4453b89f8a2c19f8e205` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:25.665416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c7d2-f9af-446a-8785-88afac1a5571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=982c0dd647db4453b89f8a2c19f8e205)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:25.666850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c7d2-f9af-446a-8785-88afac1a5571 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:25.668381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 448/885] 10.222.0.25 () {56 vars in 1183 bytes} [Sun Oct 23 02:00:25 2022] GET /identity/v3/domains/982c0dd647db4453b89f8a2c19f8e205 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:25.674002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35315ae-7501-4259-b4c4-98133ff5f653 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:25.766824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35315ae-7501-4259-b4c4-98133ff5f653 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:25.799581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1933b3f-a1c3-4195-9217-cb14920c0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:25.800113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1933b3f-a1c3-4195-9217-cb14920c0e3b None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:25.800387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1933b3f-a1c3-4195-9217-cb14920c0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:25.800652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1933b3f-a1c3-4195-9217-cb14920c0e3b None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:25.801321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1933b3f-a1c3-4195-9217-cb14920c0e3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:25.802718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1933b3f-a1c3-4195-9217-cb14920c0e3b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:25.827868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 438/886] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 02:00:25 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:00:27.983830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef571-c8c3-4bee-bd9f-8ff14f5776df None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:27.984464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef571-c8c3-4bee-bd9f-8ff14f5776df None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:27.984464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef571-c8c3-4bee-bd9f-8ff14f5776df None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:27.985720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 449/887] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:27.991000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6332c-837e-4d03-8ac4-42f29772641c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:27.991415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6332c-837e-4d03-8ac4-42f29772641c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:27.991544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6332c-837e-4d03-8ac4-42f29772641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:28.009597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b8a6332c-837e-4d03-8ac4-42f29772641c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:28.010743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b8a6332c-837e-4d03-8ac4-42f29772641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:28.019504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:28.074755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 439/888] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:28.340294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ef571-c8c3-4bee-bd9f-8ff14f5776df None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:28.395016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:28.438748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ef571-c8c3-4bee-bd9f-8ff14f5776df None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:28.470649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fd8ff-3f01-4b9c-abc3-e82ed589845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:28.471296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fd8ff-3f01-4b9c-abc3-e82ed589845b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:28.471575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fd8ff-3f01-4b9c-abc3-e82ed589845b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:28.471843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fd8ff-3f01-4b9c-abc3-e82ed589845b None admin] PATH_INFO: `/v3/domains/982c0dd647db4453b89f8a2c19f8e205` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:28.473406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fd8ff-3f01-4b9c-abc3-e82ed589845b None admin] RBAC: Authorizing `identity:get_domain(domain_id=982c0dd647db4453b89f8a2c19f8e205)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:28.474832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fd8ff-3f01-4b9c-abc3-e82ed589845b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:28.476378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 450/889] 10.222.0.25 () {56 vars in 1183 bytes} [Sun Oct 23 02:00:28 2022] GET /identity/v3/domains/982c0dd647db4453b89f8a2c19f8e205 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:28.482685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6332c-837e-4d03-8ac4-42f29772641c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:28.575455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6332c-837e-4d03-8ac4-42f29772641c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:28.607833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cae8ca-617f-4320-af83-a474188c85ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:28.608359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cae8ca-617f-4320-af83-a474188c85ee None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:28.608631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cae8ca-617f-4320-af83-a474188c85ee None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:28.608893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cae8ca-617f-4320-af83-a474188c85ee None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:28.609556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cae8ca-617f-4320-af83-a474188c85ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:28.610956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cae8ca-617f-4320-af83-a474188c85ee None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:28.627145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:28.632444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 440/890] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 02:00:28 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:00:30.775557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd139c9-88b6-4187-9d1f-a603523f1a7c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:30.776108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd139c9-88b6-4187-9d1f-a603523f1a7c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:30.776108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd139c9-88b6-4187-9d1f-a603523f1a7c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:30.777465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 451/891] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:30.782689 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54d919-de01-47f6-8563-1ab2505854a2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:30.783095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54d919-de01-47f6-8563-1ab2505854a2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:30.783241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54d919-de01-47f6-8563-1ab2505854a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:30.801588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4e54d919-de01-47f6-8563-1ab2505854a2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:30.802774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4e54d919-de01-47f6-8563-1ab2505854a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:30.866783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 441/892] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:31.136422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd139c9-88b6-4187-9d1f-a603523f1a7c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:31.234288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd139c9-88b6-4187-9d1f-a603523f1a7c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:31.255064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:31.266656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:31.267273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:31.267550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:31.267819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:31.278492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:00:31.283278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:00:31.284423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:00:31.285566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 452/893] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 02:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:00:31.290885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54d919-de01-47f6-8563-1ab2505854a2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:31.384645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54d919-de01-47f6-8563-1ab2505854a2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:31.411860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:31.417822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:31.418414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:31.418699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:31.418970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:31.419624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:00:31.419926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:31.421312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:31.429061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 442/894] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 02:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:00:31.435267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:31.531685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05de3f-35d3-46c0-9ee3-e09cfcd22746 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:31.563762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:31.564367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:31.564645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:31.564921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] PATH_INFO: `/v3/users/3508ae0eb20643229f6ec0fd871aa1e5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:31.578290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] RBAC: Authorizing `identity:get_user(user_id=3508ae0eb20643229f6ec0fd871aa1e5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:31.579730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:31.581360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 453/895] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:31 2022] GET /identity/v3/users/3508ae0eb20643229f6ec0fd871aa1e5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:31.587017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:31.682530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fd6de-b105-4a75-b391-fba07bcec144 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:31.714371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb5e5a-de41-4dcd-8b55-254aaf69f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:31.714970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5e5a-de41-4dcd-8b55-254aaf69f448 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:31.715242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5e5a-de41-4dcd-8b55-254aaf69f448 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:31.715507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5e5a-de41-4dcd-8b55-254aaf69f448 None admin] PATH_INFO: `/v3/projects/fdafb994d7864117811bbd2cb94f79b5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:31.716573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb5e5a-de41-4dcd-8b55-254aaf69f448 None admin] RBAC: Authorizing `identity:get_project(project_id=fdafb994d7864117811bbd2cb94f79b5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:31.718021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb5e5a-de41-4dcd-8b55-254aaf69f448 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:31.719591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 443/896] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 02:00:31 2022] GET /identity/v3/projects/fdafb994d7864117811bbd2cb94f79b5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:31.725579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:31.765475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:31.821338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9afdec-fa11-4ee1-8fc0-479e22e17b2f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:31.854118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c83da-a84f-4c5c-a12a-b6d629f71d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:31.854757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c83da-a84f-4c5c-a12a-b6d629f71d7a None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:31.855034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c83da-a84f-4c5c-a12a-b6d629f71d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:31.855304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c83da-a84f-4c5c-a12a-b6d629f71d7a None admin] PATH_INFO: `/v3/projects/fdafb994d7864117811bbd2cb94f79b5/users/3508ae0eb20643229f6ec0fd871aa1e5/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:31.857190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c83da-a84f-4c5c-a12a-b6d629f71d7a None admin] RBAC: Authorizing `identity:create_grant(project_id=fdafb994d7864117811bbd2cb94f79b5, user_id=3508ae0eb20643229f6ec0fd871aa1e5, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:31.858600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c83da-a84f-4c5c-a12a-b6d629f71d7a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:31.870626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 454/897] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 02:00:31 2022] PUT /identity/v3/projects/fdafb994d7864117811bbd2cb94f79b5/users/3508ae0eb20643229f6ec0fd871aa1e5/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:00:33.985552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae852b25-ba15-470c-905a-c04040ac6373 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:33.986124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae852b25-ba15-470c-905a-c04040ac6373 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:33.986124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae852b25-ba15-470c-905a-c04040ac6373 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:33.987400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 444/898] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:00:33.993128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0d99-870d-4c2d-b51e-30b30ff684c0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:33.993568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0d99-870d-4c2d-b51e-30b30ff684c0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:33.993667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0d99-870d-4c2d-b51e-30b30ff684c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:34.011189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e7cf0d99-870d-4c2d-b51e-30b30ff684c0 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:34.012341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7cf0d99-870d-4c2d-b51e-30b30ff684c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:34.074768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 455/899] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:00:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:00:34.342218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae852b25-ba15-470c-905a-c04040ac6373 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:34.400405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:34.441006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae852b25-ba15-470c-905a-c04040ac6373 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:34.473029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:34.473632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:34.473906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:34.474169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:34.484191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:00:34.488895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:00:34.490050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:00:34.491148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 445/900] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 02:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:00:34.496570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf0d99-870d-4c2d-b51e-30b30ff684c0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:34.525171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:34.591892 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf0d99-870d-4c2d-b51e-30b30ff684c0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:34.625073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:34.625611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:34.625885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:34.626152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:34.626807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:00:34.627109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:34.628457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:34.636051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 456/901] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 02:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:34.641937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:34.736004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c996c8-4696-4a20-b1f2-daa68640dfb6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:34.754441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:34.768239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:34.768851 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:34.769154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:34.769426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] PATH_INFO: `/v3/users/3508ae0eb20643229f6ec0fd871aa1e5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:34.770511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] RBAC: Authorizing `identity:get_user(user_id=3508ae0eb20643229f6ec0fd871aa1e5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:34.772080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:34.774289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 446/902] 10.222.0.25 () {56 vars in 1177 bytes} [Sun Oct 23 02:00:34 2022] GET /identity/v3/users/3508ae0eb20643229f6ec0fd871aa1e5 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:34.780128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:34.868189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:34.877233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2ac2-38e0-4b9c-a6b1-877fd397ff6d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:34.909743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:34.910332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:34.910608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:34.910876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:34.974569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:34.975993 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:35.061211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:35.071205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 457/903] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 02:00:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 02:00:35.077126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:35.173704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593393f-8825-4651-a9a5-0ddc3cfe0ffc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:35.206635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860ae96-0830-4455-b4cc-e8a1bed33163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:35.207259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860ae96-0830-4455-b4cc-e8a1bed33163 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:35.207538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860ae96-0830-4455-b4cc-e8a1bed33163 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:35.207806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860ae96-0830-4455-b4cc-e8a1bed33163 None admin] PATH_INFO: `/v3/projects/fdafb994d7864117811bbd2cb94f79b5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:35.208899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860ae96-0830-4455-b4cc-e8a1bed33163 None admin] RBAC: Authorizing `identity:get_project(project_id=fdafb994d7864117811bbd2cb94f79b5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:35.210339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860ae96-0830-4455-b4cc-e8a1bed33163 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:35.211966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 447/904] 10.222.0.25 () {56 vars in 1186 bytes} [Sun Oct 23 02:00:35 2022] GET /identity/v3/projects/fdafb994d7864117811bbd2cb94f79b5 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:35.218128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:35.313386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ac7d3-3abc-4a39-ab2c-9aff0ae60c68 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:35.345889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8bcd9-3af8-4e8f-8402-1a14e72756e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:35.346477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8bcd9-3af8-4e8f-8402-1a14e72756e3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:35.346753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8bcd9-3af8-4e8f-8402-1a14e72756e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:35.347276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8bcd9-3af8-4e8f-8402-1a14e72756e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:35.347995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8bcd9-3af8-4e8f-8402-1a14e72756e3 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=fdafb994d7864117811bbd2cb94f79b5, user.id=3508ae0eb20643229f6ec0fd871aa1e5) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:00:35.348299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8bcd9-3af8-4e8f-8402-1a14e72756e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:35.349743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8bcd9-3af8-4e8f-8402-1a14e72756e3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:35.355753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 458/905] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 02:00:35 2022] GET /identity/v3/role_assignments?user.id=3508ae0eb20643229f6ec0fd871aa1e5&scope.project.id=fdafb994d7864117811bbd2cb94f79b5&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:00:45.202512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=72 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:45.353266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=72 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:30.521151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8a79-62e1-4d98-aa74-b28bfd87f516 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:30.521860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8a79-62e1-4d98-aa74-b28bfd87f516 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:30.521860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8a79-62e1-4d98-aa74-b28bfd87f516 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:30.523336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 448/906] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:30.529572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b805-8625-4179-9089-d81ba069d820 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:30.530050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b805-8625-4179-9089-d81ba069d820 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:30.530150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b805-8625-4179-9089-d81ba069d820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:30.552206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d225b805-8625-4179-9089-d81ba069d820 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:30.553785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d225b805-8625-4179-9089-d81ba069d820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:30.637836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 459/907] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 02:01:30.916949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc8a79-62e1-4d98-aa74-b28bfd87f516 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:31.050384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc8a79-62e1-4d98-aa74-b28bfd87f516 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:31.100487 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:31.101266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:31.101576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:31.101891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:31.117703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:31.118407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:31.135625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:31.136740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:31.138342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:31.138342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:31.138342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:31.141126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 449/908] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:31.143403 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b805-8625-4179-9089-d81ba069d820 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:31.275124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b805-8625-4179-9089-d81ba069d820 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:31.309524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:31.315912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585625d5-0756-4b76-848b-0b3c661233ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:31.316670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585625d5-0756-4b76-848b-0b3c661233ae None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:31.317321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585625d5-0756-4b76-848b-0b3c661233ae None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:31.317676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585625d5-0756-4b76-848b-0b3c661233ae None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:31.318596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585625d5-0756-4b76-848b-0b3c661233ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:31.318968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585625d5-0756-4b76-848b-0b3c661233ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:31.323310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585625d5-0756-4b76-848b-0b3c661233ae None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:31.336077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 460/909] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:31.341452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:31.417083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:31.472764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e1ded-721e-4d32-b611-7e11d76c9f1a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:31.519253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6b5d-b4cb-417c-9e3c-3287cd7f3e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:31.521345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6b5d-b4cb-417c-9e3c-3287cd7f3e7c None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:31.522321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6b5d-b4cb-417c-9e3c-3287cd7f3e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:31.522892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6b5d-b4cb-417c-9e3c-3287cd7f3e7c None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:31.523869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6b5d-b4cb-417c-9e3c-3287cd7f3e7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:31.525795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6b5d-b4cb-417c-9e3c-3287cd7f3e7c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:31.554361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 450/910] 10.222.0.25 () {60 vars in 1132 bytes} [Sun Oct 23 02:01:31 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:01:34.052000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b73930-b33c-4fdc-bd73-4f3be25d2d49 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:34.053379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b73930-b33c-4fdc-bd73-4f3be25d2d49 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:34.053379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b73930-b33c-4fdc-bd73-4f3be25d2d49 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:34.054359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 461/911] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:34.061488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ffba2-40b8-44ca-b696-d948e652ea34 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:34.061928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ffba2-40b8-44ca-b696-d948e652ea34 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:34.062025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ffba2-40b8-44ca-b696-d948e652ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:34.087818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f14ffba2-40b8-44ca-b696-d948e652ea34 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:34.089224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f14ffba2-40b8-44ca-b696-d948e652ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:34.184226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 451/912] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:01:34.472004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b73930-b33c-4fdc-bd73-4f3be25d2d49 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:34.598529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b73930-b33c-4fdc-bd73-4f3be25d2d49 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:34.637620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:34.638302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:34.638673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:34.638846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:34.651352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:01:34.656364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:34.657503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:34.658854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 462/913] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 02:01:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:34.664663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ffba2-40b8-44ca-b696-d948e652ea34 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:34.713010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:34.794530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ffba2-40b8-44ca-b696-d948e652ea34 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:34.838340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:34.838975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:34.839257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:34.839601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:34.840279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:34.840532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:34.841949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:34.851370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 452/914] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 02:01:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:34.857840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:34.917401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:34.979488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c38ea-06c8-4079-8073-62c9558ebe4e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:35.016669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:35.017328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:35.017603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:35.017870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:35.030152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:35.031772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:35.049976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:35.051410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:35.053559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:35.053559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:35.053559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:35.053559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 463/915] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:35.057026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:35.166399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:35.169494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243a05d-e0b1-4d80-aaa6-0d1d08c30666 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:35.205804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:35.206407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:35.206682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:35.206949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:35.208097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:35.208399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:35.209815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:35.224025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 453/916] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:01:35.229750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:35.341750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb49d-bbcc-4b1c-bd7f-b9841c5b194c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:35.343407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:35.381823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:35.382613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:35.382965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:35.383238 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:35.391651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:35.393177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 02:01:35.406267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:35.407312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:35.408296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:35.413007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 464/917] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:35.413372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:35.526290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebe3f-78c0-440d-908e-8fd1eb5ea1cc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:35.567717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:35.568610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:35.568838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:35.569152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:35.570043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:35.570349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:35.571924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:35.598588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 454/918] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Oct 23 02:01:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:35.599698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:35.712785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebe99-a10c-4b1a-9198-a069150ac506 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:35.757813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:35.758480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:35.758764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:35.759315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:35.774061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:35.775538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:35.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:35.795218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:35.796263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:35.796263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:35.796263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:35.798188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 465/919] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:35.805100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:35.833619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:35.918777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7454d-69c9-4a44-a17e-d55f01cc42f3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:35.953367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:35.953970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:35.954247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:35.954522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:35.955148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:35.955447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:35.956804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:35.968519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 455/920] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:35.974743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:35.991807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:36.086138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76a6a7-0796-406b-8c8c-1793bd93f290 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:36.126984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:36.127629 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:36.127913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:36.128192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:36.136189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:36.137720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 02:01:36.149164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:36.150599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:36.151679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 466/921] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 02:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:36.156494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:36.246515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:36.272044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce318d5-595c-4c60-9ddf-489200842f22 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:36.307978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d98e0-d836-46d0-8ad6-3aa17f3c467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:36.308603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d98e0-d836-46d0-8ad6-3aa17f3c467e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:36.308874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d98e0-d836-46d0-8ad6-3aa17f3c467e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:36.309236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d98e0-d836-46d0-8ad6-3aa17f3c467e None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:36.309925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d98e0-d836-46d0-8ad6-3aa17f3c467e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:36.310261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d98e0-d836-46d0-8ad6-3aa17f3c467e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:36.311935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d98e0-d836-46d0-8ad6-3aa17f3c467e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:36.325338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 456/922] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 02:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:36.331631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:36.413297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:36.440279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac564-177d-4a93-8085-b42186a0fe94 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:36.478541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28586bd-30b3-46f3-b2e5-477e3c49e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:36.479425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28586bd-30b3-46f3-b2e5-477e3c49e317 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:36.479716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28586bd-30b3-46f3-b2e5-477e3c49e317 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:36.479991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28586bd-30b3-46f3-b2e5-477e3c49e317 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/c398dc49ac8241aab3112a5ac879b2ca/roles/dbdb37f44805407aaab363304c78b581` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:36.494768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28586bd-30b3-46f3-b2e5-477e3c49e317 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=c398dc49ac8241aab3112a5ac879b2ca, role_id=dbdb37f44805407aaab363304c78b581)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:36.496213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28586bd-30b3-46f3-b2e5-477e3c49e317 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:36.508296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 467/923] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 02:01:36 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/c398dc49ac8241aab3112a5ac879b2ca/roles/dbdb37f44805407aaab363304c78b581 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:01:38.790044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a5328-f381-451d-911f-c927bd785536 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:38.790781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a5328-f381-451d-911f-c927bd785536 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:38.790781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a5328-f381-451d-911f-c927bd785536 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:38.791942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 457/924] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:38.797840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9cae-ab58-463f-8733-c570ff8a3f53 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:38.798390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9cae-ab58-463f-8733-c570ff8a3f53 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:38.798390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9cae-ab58-463f-8733-c570ff8a3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:38.816159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b12b9cae-ab58-463f-8733-c570ff8a3f53 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:38.817390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b12b9cae-ab58-463f-8733-c570ff8a3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:38.886610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 468/925] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:01:39.163157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a5328-f381-451d-911f-c927bd785536 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:39.266990 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a5328-f381-451d-911f-c927bd785536 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:39.304102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:39.304738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:39.305044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:39.305319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:39.312806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:39.317414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:01:39.322399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:39.323676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:39.324650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 458/926] 10.222.0.25 () {56 vars in 1102 bytes} [Sun Oct 23 02:01:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:39.329752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9cae-ab58-463f-8733-c570ff8a3f53 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:39.385519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:39.433284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9cae-ab58-463f-8733-c570ff8a3f53 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:39.471761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:39.472378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:39.472657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:39.473531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:39.474199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:39.474501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:39.475866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:39.483964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 469/927] 10.222.0.25 () {56 vars in 1103 bytes} [Sun Oct 23 02:01:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:39.490136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:39.593453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e7477-422b-438f-94ac-3a803d953e6f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:39.627797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:39.628429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:39.628706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:39.629122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:39.639209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:39.640437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:39.655419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:39.656629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:39.657750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:39.657750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:39.657750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:39.657750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 459/928] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 02:01:39.665179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:39.777410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e891-670c-4cb2-b8b6-da838cfd3785 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:39.795865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:39.816308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:39.817065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:39.817350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:39.817628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:39.818375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:39.818748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:39.820142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:39.833330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 470/929] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:01:39.839351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:39.895451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:39.953985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9263c-b2ed-4341-a8a3-fac4f62e5009 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:39.999805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:40.000813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:40.001323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:40.001799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:40.017536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:40.019712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 02:01:40.034661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:40.042874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:40.044820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 460/930] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:40.045683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:40.163631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda402b-2d17-4ebc-acbd-d9100e2ffb07 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:40.200174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:40.200788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:40.201093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:40.201366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:40.202094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:40.202399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:40.203827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:40.221203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 471/931] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Oct 23 02:01:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:01:40.227656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:40.340478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b17e4-2cb4-4e77-8c33-a063908ce8e9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:40.351908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:40.381323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:40.381919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:40.382193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:40.382459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:40.458663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:40.460340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:40.571072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 461/932] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 02:01:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 02:01:40.577291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:40.613686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:40.682406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a725a-6eb9-44eb-be5e-cf7bf066bf91 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:40.718218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:40.718768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:40.719057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:40.719321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:40.731888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:40.733707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:40.751581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:40.752951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:40.754667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:40.754667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:40.754667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:40.754667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 472/933] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:40.760425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:40.774065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:40.870704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074751d-67af-4c88-b23c-6035599bc432 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:40.907694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:40.908303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:40.908579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:40.908846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:40.909504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:40.909805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:40.911175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:40.922512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 462/934] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:40.929515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:41.027800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:41.044745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33214ee-cf7f-40a0-91c2-abaa8e6370ad None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:41.087517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:41.088147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:41.088484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:41.088699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:41.095999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:41.097486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 02:01:41.108708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:41.109631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:41.110612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 473/935] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 02:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:41.118356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:41.190130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:41.222109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbee278-e876-497e-ae2a-4097e6fac988 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:41.258563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d7822-8410-42f7-8694-111dcad19c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:41.259170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7822-8410-42f7-8694-111dcad19c51 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:41.259446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7822-8410-42f7-8694-111dcad19c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:41.259712 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7822-8410-42f7-8694-111dcad19c51 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:41.260393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d7822-8410-42f7-8694-111dcad19c51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:41.260702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d7822-8410-42f7-8694-111dcad19c51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:41.262146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d7822-8410-42f7-8694-111dcad19c51 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:41.274736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 463/936] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 02:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:41.281062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:41.395490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8aba3-ce16-49cb-83f8-bac2c3669b04 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:41.432004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8efb-4dd1-48bf-97b0-dc3db4b24704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:41.432707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8efb-4dd1-48bf-97b0-dc3db4b24704 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:41.433038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8efb-4dd1-48bf-97b0-dc3db4b24704 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:41.433264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8efb-4dd1-48bf-97b0-dc3db4b24704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:41.434005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8efb-4dd1-48bf-97b0-dc3db4b24704 None admin] RBAC: Adding query filter params (role.id=dbdb37f44805407aaab363304c78b581, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=c398dc49ac8241aab3112a5ac879b2ca) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:41.434304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8efb-4dd1-48bf-97b0-dc3db4b24704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:41.435719 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8efb-4dd1-48bf-97b0-dc3db4b24704 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:41.441841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 474/937] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 02:01:41 2022] GET /identity/v3/role_assignments?user.id=c398dc49ac8241aab3112a5ac879b2ca&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=dbdb37f44805407aaab363304c78b581 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:01:43.639428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ee078-f45c-4df5-bdfb-99b4c887f4e7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:43.640036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ee078-f45c-4df5-bdfb-99b4c887f4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:43.640036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ee078-f45c-4df5-bdfb-99b4c887f4e7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:43.641328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 464/938] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:43.646972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2466f-22ac-4de4-8dfe-1efbd31b66e1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:43.647475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2466f-22ac-4de4-8dfe-1efbd31b66e1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:43.647607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2466f-22ac-4de4-8dfe-1efbd31b66e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:43.666669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4bd2466f-22ac-4de4-8dfe-1efbd31b66e1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:43.667959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4bd2466f-22ac-4de4-8dfe-1efbd31b66e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:43.670915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:43.744656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 475/939] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:01:44.021826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ee078-f45c-4df5-bdfb-99b4c887f4e7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:44.131785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ee078-f45c-4df5-bdfb-99b4c887f4e7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:44.163177 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:44.170336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:44.171129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:44.171402 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:44.171669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:44.184386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:01:44.190333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:44.191498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:44.192659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 465/940] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 02:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:44.198720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2466f-22ac-4de4-8dfe-1efbd31b66e1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:44.304303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2466f-22ac-4de4-8dfe-1efbd31b66e1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:44.343837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:44.344501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:44.345123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:44.345438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:44.346116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:44.346442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:44.347869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:44.357665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 476/941] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 02:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:44.363759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:44.475940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7e003-dfdd-4848-b961-4c28c3ac9d8d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:44.517219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:44.517905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:44.518236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:44.518562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:44.532909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:44.534410 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:44.551021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:44.554726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:44.555735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:44.555735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:44.555735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:44.555735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 466/942] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:44.558897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:44.562637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:44.672029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd8295-90e5-4a57-8d6a-0e1d441efc81 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:44.708447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:44.709175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:44.709536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:44.709873 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:44.710698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:44.711119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:44.712769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:44.727380 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 477/943] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:44.734668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:44.790576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:44.856335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e843d-81cc-4bea-abf7-938211f7e9d5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:44.891980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:44.892732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:44.893103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:44.893418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:44.902949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:44.904792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 02:01:44.917817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:44.918985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:44.920095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 467/944] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 02:01:44.924768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:44.988934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:45.031954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd42ff-9300-4d3f-9a22-a925a949cbb3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:45.066696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:45.067328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:45.067578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:45.067890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:45.068639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:45.068937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:45.070549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:45.088883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 478/945] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Oct 23 02:01:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:45.095366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:45.210146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f707f7f-53f9-4b5f-ac5d-153777c915a1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:45.211793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:45.248084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:45.248796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:45.249147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:45.249429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:45.262108 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:45.263636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:45.280151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:45.281381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:45.282278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:45.282278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:45.282278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:45.282278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 468/946] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:45.287902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:45.399894 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecdac-3bef-492c-bc50-8e24f993c849 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:45.423628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:45.439957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:45.440670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:45.440953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:45.441354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:45.442112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:45.442514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:45.444112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:45.460489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 479/947] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:45.462298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:45.572056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47cd81-ccbf-4dae-9729-532bab308b4a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:45.609771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:45.610786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:45.611066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:45.611346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:45.619828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:45.621317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 02:01:45.633618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:45.634945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:45.636307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 469/948] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 02:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:45.641076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:45.756007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2443-bca3-4428-812c-ee495ba132c8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:45.800896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e415104-6d8f-4a49-a7fb-27df9a12a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:45.801696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e415104-6d8f-4a49-a7fb-27df9a12a341 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:45.802051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e415104-6d8f-4a49-a7fb-27df9a12a341 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:45.802338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e415104-6d8f-4a49-a7fb-27df9a12a341 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:45.803049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e415104-6d8f-4a49-a7fb-27df9a12a341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:45.803394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e415104-6d8f-4a49-a7fb-27df9a12a341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:45.804938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e415104-6d8f-4a49-a7fb-27df9a12a341 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:45.819292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 480/949] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 02:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:45.825779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:45.845853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:45.939133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45576e10-3709-4817-bf89-d754b0e3d5d3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:45.976714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bac9c9-8113-4668-bf06-89326f5d81d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:45.977396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bac9c9-8113-4668-bf06-89326f5d81d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:45.977676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bac9c9-8113-4668-bf06-89326f5d81d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:45.977948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bac9c9-8113-4668-bf06-89326f5d81d0 None admin] PATH_INFO: `/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/c398dc49ac8241aab3112a5ac879b2ca/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:45.980048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bac9c9-8113-4668-bf06-89326f5d81d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=326d23431da14b53b9d6bf3660131ab0, user_id=c398dc49ac8241aab3112a5ac879b2ca, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:45.981624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bac9c9-8113-4668-bf06-89326f5d81d0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:45.996364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 470/950] 10.222.0.25 () {58 vars in 1439 bytes} [Sun Oct 23 02:01:45 2022] PUT /identity/v3/projects/326d23431da14b53b9d6bf3660131ab0/users/c398dc49ac8241aab3112a5ac879b2ca/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:01:48.185327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094df4da-621b-49be-892c-5e741d7e493b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:48.185855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094df4da-621b-49be-892c-5e741d7e493b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:48.185855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094df4da-621b-49be-892c-5e741d7e493b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:48.187279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 481/951] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:48.192933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dcce3-8723-4a49-a1ff-ab3a4c33c9f7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:48.193426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dcce3-8723-4a49-a1ff-ab3a4c33c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:48.193517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dcce3-8723-4a49-a1ff-ab3a4c33c9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:48.211771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bf0dcce3-8723-4a49-a1ff-ab3a4c33c9f7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:48.212945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bf0dcce3-8723-4a49-a1ff-ab3a4c33c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:48.282478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 471/952] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:01:48.569053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094df4da-621b-49be-892c-5e741d7e493b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:48.615433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:48.678012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094df4da-621b-49be-892c-5e741d7e493b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:48.716031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:48.716667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:48.716948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:48.717248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:48.729623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 02:01:48.734616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:48.735771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:48.736736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 482/953] 10.222.0.25 () {56 vars in 1096 bytes} [Sun Oct 23 02:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:48.741976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dcce3-8723-4a49-a1ff-ab3a4c33c9f7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:48.745246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:48.852823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dcce3-8723-4a49-a1ff-ab3a4c33c9f7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:48.891645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:48.892253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:48.892528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:48.892796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:48.893483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:48.893783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:48.895836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:48.904701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 472/954] 10.222.0.25 () {56 vars in 1099 bytes} [Sun Oct 23 02:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:01:48.911189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:49.018546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:49.023223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961494f0-7b95-4d10-96e7-78f1ebd893bb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:49.062256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:49.063132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:49.063413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:49.063685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:49.077329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:49.079225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:49.097597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:49.098895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:49.099968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:49.099968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:49.099968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:49.099968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 483/955] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 02:01:49.104743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:49.180077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:49.219484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc69a23-a594-4061-a535-759da3f3ec2c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:49.259582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:49.260302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:49.260689 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:49.261212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:49.261863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:49.262393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:49.263908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:49.276604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 473/956] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:49.282480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:49.392180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760c844-8bf9-4d0d-9c0b-ac971e8d9a2c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:49.434964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:49.435629 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:49.435908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:49.436180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:49.444767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:49.446291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 02:01:49.459460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:49.460647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:49.466768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 484/957] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:49.467509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:49.571071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438a558-92bf-402f-a1e9-1fc49fba1cd3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:49.598924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:49.608550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:49.609209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:49.609485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:49.609806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:49.610629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:49.610936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:49.612373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:49.630865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 474/958] 10.222.0.25 () {56 vars in 1143 bytes} [Sun Oct 23 02:01:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:01:49.636713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:49.653446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:49.744902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540fbf9-4f9a-47ce-8ac4-c07f8fbf6b8d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:49.792190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:49.792818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:49.793129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:49.793399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:49.865989 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:49.867438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:49.881280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:49.965073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 485/959] 10.222.0.25 () {58 vars in 1282 bytes} [Sun Oct 23 02:01:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 02:01:49.971041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:50.072266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1942305-16ee-48e5-aad0-1be681efc867 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:50.105913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:50.106532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:50.106802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:50.107067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:50.116878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:50.118336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 02:01:50.132267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:50.133421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 02:01:50.134532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 02:01:50.134532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 02:01:50.134532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:50.134532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 475/960] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:50.140701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:50.236789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f711-89b0-4c36-a1dd-98915e937fb8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:50.249385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:50.270501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:50.271100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:50.271375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:50.271644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:50.272277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:50.272579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:50.273973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:50.285435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 486/961] 10.222.0.25 () {56 vars in 1109 bytes} [Sun Oct 23 02:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:50.291038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:50.325111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:50.387933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902a53f-1779-4d8b-9866-2ab72fc12b12 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:50.419937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:50.420546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:50.420817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:50.421112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:50.427491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:50.428904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 02:01:50.439756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:50.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 23 02:01:50.442480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 476/962] 10.222.0.25 () {56 vars in 1111 bytes} [Sun Oct 23 02:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:50.447108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:50.542322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4dea9-12af-47ca-a15e-fe302a4d75ad None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:50.574053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c865dbc-f529-48be-8dbc-74b2eb34c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:50.574651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865dbc-f529-48be-8dbc-74b2eb34c29d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:50.574927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865dbc-f529-48be-8dbc-74b2eb34c29d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:50.575198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865dbc-f529-48be-8dbc-74b2eb34c29d None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:50.575881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c865dbc-f529-48be-8dbc-74b2eb34c29d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:50.576194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c865dbc-f529-48be-8dbc-74b2eb34c29d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:50.577634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c865dbc-f529-48be-8dbc-74b2eb34c29d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:50.589521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 487/963] 10.222.0.25 () {56 vars in 1148 bytes} [Sun Oct 23 02:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:50.595739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:50.684203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:50.690095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7304-b06b-4841-834e-97e97066ca79 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:50.722115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d06c-e449-4393-b694-42432a770b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:50.722693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d06c-e449-4393-b694-42432a770b73 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:50.722967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d06c-e449-4393-b694-42432a770b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:50.723233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d06c-e449-4393-b694-42432a770b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:50.723935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d06c-e449-4393-b694-42432a770b73 None admin] RBAC: Adding query filter params (role.id=d4631e3f8b6d42e49362077c08a5acc7, scope.project.id=326d23431da14b53b9d6bf3660131ab0, user.id=c398dc49ac8241aab3112a5ac879b2ca) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:50.724235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d06c-e449-4393-b694-42432a770b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:50.725652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d06c-e449-4393-b694-42432a770b73 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:50.731562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 477/964] 10.222.0.25 () {56 vars in 1374 bytes} [Sun Oct 23 02:01:50 2022] GET /identity/v3/role_assignments?user.id=c398dc49ac8241aab3112a5ac879b2ca&scope.project.id=326d23431da14b53b9d6bf3660131ab0&role.id=d4631e3f8b6d42e49362077c08a5acc7 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:52.845938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc10e-f143-4489-bb2d-04f90425a94a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:52.846467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc10e-f143-4489-bb2d-04f90425a94a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:52.846467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc10e-f143-4489-bb2d-04f90425a94a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:52.847801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 488/965] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:52.852995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661e86-85ad-4e5d-a740-24b0aee2f187 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:52.853366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661e86-85ad-4e5d-a740-24b0aee2f187 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:52.853547 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661e86-85ad-4e5d-a740-24b0aee2f187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:52.871090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b8661e86-85ad-4e5d-a740-24b0aee2f187 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:52.872251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b8661e86-85ad-4e5d-a740-24b0aee2f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:52.935926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 478/966] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:01:53.203494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc10e-f143-4489-bb2d-04f90425a94a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:53.233593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:53.301981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc10e-f143-4489-bb2d-04f90425a94a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:53.334307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:53.334917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:53.335191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:53.335458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:53.336025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:53.337412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:53.346150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:53.347856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:53.348696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 489/967] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 02:01:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:53.353802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661e86-85ad-4e5d-a740-24b0aee2f187 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:53.439321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:53.449475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661e86-85ad-4e5d-a740-24b0aee2f187 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:53.482189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de69000-a879-41f9-96f6-df1207f9fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:53.482778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de69000-a879-41f9-96f6-df1207f9fdbf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:53.483057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de69000-a879-41f9-96f6-df1207f9fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:53.483328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de69000-a879-41f9-96f6-df1207f9fdbf None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:53.483938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de69000-a879-41f9-96f6-df1207f9fdbf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:53.484237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de69000-a879-41f9-96f6-df1207f9fdbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:53.485612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de69000-a879-41f9-96f6-df1207f9fdbf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:53.490244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 479/968] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Oct 23 02:01:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:53.495856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:53.587322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:53.593251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda79053-240d-4c9e-8a1d-0da77baabde7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:53.625487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db5486-a6f7-4a49-a8ae-eb141a2bcedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:53.626084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5486-a6f7-4a49-a8ae-eb141a2bcedb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:53.626365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5486-a6f7-4a49-a8ae-eb141a2bcedb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:53.626639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5486-a6f7-4a49-a8ae-eb141a2bcedb None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:53.627261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db5486-a6f7-4a49-a8ae-eb141a2bcedb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:53.627564 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db5486-a6f7-4a49-a8ae-eb141a2bcedb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:53.629490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db5486-a6f7-4a49-a8ae-eb141a2bcedb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:53.633822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 490/969] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Oct 23 02:01:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:55.752463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842a8b9-e7f3-45ab-b41d-79aba4e66799 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:55.753524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842a8b9-e7f3-45ab-b41d-79aba4e66799 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:55.753605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842a8b9-e7f3-45ab-b41d-79aba4e66799 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:55.754883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 480/970] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:55.760144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b711d1-df1a-48bf-b8b1-2dd7a1d871a9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:55.760586 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b711d1-df1a-48bf-b8b1-2dd7a1d871a9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:55.760681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b711d1-df1a-48bf-b8b1-2dd7a1d871a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:55.778972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-48b711d1-df1a-48bf-b8b1-2dd7a1d871a9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:55.780129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-48b711d1-df1a-48bf-b8b1-2dd7a1d871a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:55.842981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 491/971] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:01:56.107028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842a8b9-e7f3-45ab-b41d-79aba4e66799 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:56.204287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842a8b9-e7f3-45ab-b41d-79aba4e66799 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:56.236321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbb6a1-8827-473d-8df4-2c50d3f4acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:56.236906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbb6a1-8827-473d-8df4-2c50d3f4acaa None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:56.237210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbb6a1-8827-473d-8df4-2c50d3f4acaa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:56.237987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbb6a1-8827-473d-8df4-2c50d3f4acaa None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:56.238613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbb6a1-8827-473d-8df4-2c50d3f4acaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:56.239947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbb6a1-8827-473d-8df4-2c50d3f4acaa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:56.254957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 481/972] 10.222.0.25 () {60 vars in 1141 bytes} [Sun Oct 23 02:01:56 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:01:58.389508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8bec-5dcd-4499-8446-f9b9e8f97dc7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:58.390009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8bec-5dcd-4499-8446-f9b9e8f97dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:58.390009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8bec-5dcd-4499-8446-f9b9e8f97dc7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:58.391350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 492/973] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:01:58.396900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a25e-80f8-4892-bd97-a6c3e435e8d5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:58.397353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a25e-80f8-4892-bd97-a6c3e435e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:58.397485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a25e-80f8-4892-bd97-a6c3e435e8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:58.415640 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-acd9a25e-80f8-4892-bd97-a6c3e435e8d5 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:58.416805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-acd9a25e-80f8-4892-bd97-a6c3e435e8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:58.425729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:58.488275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 482/974] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:01:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:01:58.761149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8bec-5dcd-4499-8446-f9b9e8f97dc7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:58.853082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:58.863721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8bec-5dcd-4499-8446-f9b9e8f97dc7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:58.897685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:58.898306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:58.898588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:58.898866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:58.899442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:58.900799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:01:58.909481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:01:58.910620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:01:58.911624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 493/975] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 02:01:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:01:58.916630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9a25e-80f8-4892-bd97-a6c3e435e8d5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:59.010898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9a25e-80f8-4892-bd97-a6c3e435e8d5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:59.042401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:59.042923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:59.043197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:59.043463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:59.044077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:59.044370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:59.045737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:59.051284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 483/976] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Oct 23 02:01:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:59.057155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:59.155844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9e7bf-6113-497b-86b8-c4709eff1dfa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:59.187611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35fae4-fd1d-4525-8770-bee24c1ac999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:59.188204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35fae4-fd1d-4525-8770-bee24c1ac999 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:59.188479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35fae4-fd1d-4525-8770-bee24c1ac999 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:59.188745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35fae4-fd1d-4525-8770-bee24c1ac999 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:59.189457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35fae4-fd1d-4525-8770-bee24c1ac999 None admin] RBAC: Adding query filter params (interface=public, service_id=65158fe5d0b344d48192b4ae44ba28ba, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:01:59.189757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35fae4-fd1d-4525-8770-bee24c1ac999 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:59.191655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35fae4-fd1d-4525-8770-bee24c1ac999 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:59.196458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 494/977] 10.222.0.25 () {56 vars in 1251 bytes} [Sun Oct 23 02:01:59 2022] GET /identity/v3/endpoints?service_id=65158fe5d0b344d48192b4ae44ba28ba&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:01:59.202075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:59.205836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:59.297888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d82a0-72a7-4170-aa06-9feccef6cc1e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:59.332624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f83f35-c534-4bd1-9f59-8e029b1edffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:59.333259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83f35-c534-4bd1-9f59-8e029b1edffc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:59.333538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83f35-c534-4bd1-9f59-8e029b1edffc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:59.333809 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83f35-c534-4bd1-9f59-8e029b1edffc None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:59.334403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f83f35-c534-4bd1-9f59-8e029b1edffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:59.335753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f83f35-c534-4bd1-9f59-8e029b1edffc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:59.342458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 484/978] 10.222.0.25 () {56 vars in 1087 bytes} [Sun Oct 23 02:01:59 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:02:01.456385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320bfe-e87d-404d-9ec7-9ee98b8b49b4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:02:01.456917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320bfe-e87d-404d-9ec7-9ee98b8b49b4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:02:01.456917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320bfe-e87d-404d-9ec7-9ee98b8b49b4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:02:01.458304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 495/979] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:02:01.463594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf03cd-e532-4359-a0f2-87f0816031d2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:02:01.463979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf03cd-e532-4359-a0f2-87f0816031d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:02:01.464137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf03cd-e532-4359-a0f2-87f0816031d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:02:01.482664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4faf03cd-e532-4359-a0f2-87f0816031d2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:02:01.483837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4faf03cd-e532-4359-a0f2-87f0816031d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:02:01.543224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:02:01.548925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 485/980] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:02:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 02:02:01.825568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320bfe-e87d-404d-9ec7-9ee98b8b49b4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:02:01.845291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:02:01.925034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320bfe-e87d-404d-9ec7-9ee98b8b49b4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:02:01.957237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:02:01.957853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:02:01.958131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:02:01.958401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:02:01.958970 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:02:01.960327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 02:02:01.968904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 02:02:01.970418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 23 02:02:01.971394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 496/981] 10.222.0.25 () {56 vars in 1117 bytes} [Sun Oct 23 02:02:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 02:02:01.976187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf03cd-e532-4359-a0f2-87f0816031d2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:02:02.071685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf03cd-e532-4359-a0f2-87f0816031d2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:02:02.104180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1ac55-59df-41e0-8e46-a7e30ad2631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:02:02.104714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ac55-59df-41e0-8e46-a7e30ad2631f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:02:02.105024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ac55-59df-41e0-8e46-a7e30ad2631f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:02:02.105300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ac55-59df-41e0-8e46-a7e30ad2631f None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:02:02.105924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1ac55-59df-41e0-8e46-a7e30ad2631f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:02:02.106226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1ac55-59df-41e0-8e46-a7e30ad2631f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:02:02.107589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1ac55-59df-41e0-8e46-a7e30ad2631f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:02:02.113475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 486/982] 10.222.0.25 () {56 vars in 1116 bytes} [Sun Oct 23 02:02:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:02:02.118952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:02:02.198336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:02:02.216248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ac2a-b72f-4960-8067-eb472279fad4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:02:02.248587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bde87f-d124-4c3e-b009-6e5b1356dbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:02:02.249207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bde87f-d124-4c3e-b009-6e5b1356dbc3 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:02:02.249488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bde87f-d124-4c3e-b009-6e5b1356dbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:02:02.249756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bde87f-d124-4c3e-b009-6e5b1356dbc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:02:02.250418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bde87f-d124-4c3e-b009-6e5b1356dbc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:02:02.251762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bde87f-d124-4c3e-b009-6e5b1356dbc3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:02:02.270783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 497/983] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:02:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:02:12.110373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=69 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:02:12.266948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:05.521881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befa69-dcc0-4b52-b2ea-3cbf5a82c13e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:05.521881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befa69-dcc0-4b52-b2ea-3cbf5a82c13e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:05.524642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befa69-dcc0-4b52-b2ea-3cbf5a82c13e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:05.532218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364507a-6455-4334-afc9-22590fed1549 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:05.532676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 487/984] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:05.533222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364507a-6455-4334-afc9-22590fed1549 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:05.533674 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364507a-6455-4334-afc9-22590fed1549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:05.645396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5364507a-6455-4334-afc9-22590fed1549 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:05.647064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5364507a-6455-4334-afc9-22590fed1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:05.781023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 498/985] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:06.079398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557126a-aa51-4d81-9251-7169912414a2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:06.079725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557126a-aa51-4d81-9251-7169912414a2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:06.079941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557126a-aa51-4d81-9251-7169912414a2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:06.081461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 488/986] 10.222.0.25 () {54 vars in 964 bytes} [Sun Oct 23 02:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:06.087112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f594f-7c91-428d-baea-0356a11c0b0d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:06.087653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f594f-7c91-428d-baea-0356a11c0b0d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:06.088001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f594f-7c91-428d-baea-0356a11c0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:06.167470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c23f594f-7c91-428d-baea-0356a11c0b0d None None] MFA Rules not processed for user `1dc28ef7b36746208560692b17809e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:06.168767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c23f594f-7c91-428d-baea-0356a11c0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:06.190785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:06.250767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 499/987] 10.222.0.25 () {58 vars in 1061 bytes} [Sun Oct 23 02:03:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:06.259674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557126a-aa51-4d81-9251-7169912414a2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:06.261467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3557126a-aa51-4d81-9251-7169912414a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:06.388528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557126a-aa51-4d81-9251-7169912414a2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:06.471720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1419f-f8da-4a81-8fe6-c5a8143d92e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:06.472327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1419f-f8da-4a81-8fe6-c5a8143d92e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:06.472599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1419f-f8da-4a81-8fe6-c5a8143d92e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:06.472862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1419f-f8da-4a81-8fe6-c5a8143d92e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:06.474473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-68a1419f-f8da-4a81-8fe6-c5a8143d92e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:06.541206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:06.607199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1419f-f8da-4a81-8fe6-c5a8143d92e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:06.608792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1419f-f8da-4a81-8fe6-c5a8143d92e9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:06.629854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 489/988] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:09.157286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b97c01-bec4-46cf-8fb8-b78f332452ae None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:09.157871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b97c01-bec4-46cf-8fb8-b78f332452ae None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:09.157871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b97c01-bec4-46cf-8fb8-b78f332452ae None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:09.159213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 500/989] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:09.165095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31e9e-86a2-4667-81ba-9204d78fedbc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:09.165573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31e9e-86a2-4667-81ba-9204d78fedbc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:09.165689 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31e9e-86a2-4667-81ba-9204d78fedbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:09.249858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-03f31e9e-86a2-4667-81ba-9204d78fedbc None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:09.251083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-03f31e9e-86a2-4667-81ba-9204d78fedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:09.348440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 490/990] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:09.630698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b97c01-bec4-46cf-8fb8-b78f332452ae None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:09.632519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a7b97c01-bec4-46cf-8fb8-b78f332452ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:09.733838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b97c01-bec4-46cf-8fb8-b78f332452ae None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:09.802346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:09.804718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276c7c8-e2dd-4e0b-946d-74747c90fa45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:09.805589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276c7c8-e2dd-4e0b-946d-74747c90fa45 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:09.805910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276c7c8-e2dd-4e0b-946d-74747c90fa45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:09.806321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276c7c8-e2dd-4e0b-946d-74747c90fa45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:09.808106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4276c7c8-e2dd-4e0b-946d-74747c90fa45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:09.913250 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276c7c8-e2dd-4e0b-946d-74747c90fa45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:09.914602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276c7c8-e2dd-4e0b-946d-74747c90fa45 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:09.932768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 501/991] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:12.379509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457817-0267-4b6e-8d6f-1344a65626d2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:12.380015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457817-0267-4b6e-8d6f-1344a65626d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:12.380015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457817-0267-4b6e-8d6f-1344a65626d2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:12.381353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 491/992] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:12.386459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595b99a-5d59-4c38-b1e9-91d05064c2ce None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:12.386856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595b99a-5d59-4c38-b1e9-91d05064c2ce None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:12.386994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595b99a-5d59-4c38-b1e9-91d05064c2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:12.450451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a595b99a-5d59-4c38-b1e9-91d05064c2ce None None] MFA Rules not processed for user `717327774a4146f69129e15672f31b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:12.451656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a595b99a-5d59-4c38-b1e9-91d05064c2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:12.501130 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:12.544622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 502/993] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:12.830512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3457817-0267-4b6e-8d6f-1344a65626d2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:12.832048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e3457817-0267-4b6e-8d6f-1344a65626d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:12.842388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:12.934759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3457817-0267-4b6e-8d6f-1344a65626d2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:13.005577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d87d5b-8550-4fcb-8db7-87756ac17ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:13.006171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d87d5b-8550-4fcb-8db7-87756ac17ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:13.006443 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d87d5b-8550-4fcb-8db7-87756ac17ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:13.006709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d87d5b-8550-4fcb-8db7-87756ac17ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:13.008255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-30d87d5b-8550-4fcb-8db7-87756ac17ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:13.068825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:13.115442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d87d5b-8550-4fcb-8db7-87756ac17ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:13.116797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d87d5b-8550-4fcb-8db7-87756ac17ea9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:13.134755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 492/994] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:15.796255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e876a-5f48-49c3-b677-f8265df81ef1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:15.796793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e876a-5f48-49c3-b677-f8265df81ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:15.796908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e876a-5f48-49c3-b677-f8265df81ef1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:15.798207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 503/995] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:15.803549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdb88-38d4-464e-8969-12ab4c42bbcf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:15.803957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdb88-38d4-464e-8969-12ab4c42bbcf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:15.804067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdb88-38d4-464e-8969-12ab4c42bbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:15.869457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3afbdb88-38d4-464e-8969-12ab4c42bbcf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:15.870637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3afbdb88-38d4-464e-8969-12ab4c42bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:15.962942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 493/996] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:16.250418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e876a-5f48-49c3-b677-f8265df81ef1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:16.251925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e69e876a-5f48-49c3-b677-f8265df81ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:16.351317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e876a-5f48-49c3-b677-f8265df81ef1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:16.422305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd167fc1-275d-4a6d-ad49-4a02237878c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:16.422830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd167fc1-275d-4a6d-ad49-4a02237878c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:16.423104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd167fc1-275d-4a6d-ad49-4a02237878c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:16.423368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd167fc1-275d-4a6d-ad49-4a02237878c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:16.424914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd167fc1-275d-4a6d-ad49-4a02237878c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:16.431550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:16.530207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd167fc1-275d-4a6d-ad49-4a02237878c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:16.531615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd167fc1-275d-4a6d-ad49-4a02237878c2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:16.549315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 504/997] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:19.308163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb82e3-c1a5-424d-b359-a696e918a4e2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:19.308700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb82e3-c1a5-424d-b359-a696e918a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:19.308700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb82e3-c1a5-424d-b359-a696e918a4e2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:19.310746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 494/998] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:19.315778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc08ef-f0dd-4f74-9881-1657fc032e96 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:19.316176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc08ef-f0dd-4f74-9881-1657fc032e96 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:19.316325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc08ef-f0dd-4f74-9881-1657fc032e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:19.390205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-95dc08ef-f0dd-4f74-9881-1657fc032e96 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:19.391354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95dc08ef-f0dd-4f74-9881-1657fc032e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:19.452469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:19.494367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 505/999] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:19.777819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb82e3-c1a5-424d-b359-a696e918a4e2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:19.779966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e2bb82e3-c1a5-424d-b359-a696e918a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:19.800861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:19.885935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb82e3-c1a5-424d-b359-a696e918a4e2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:19.959075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47e4d1-d177-42f7-b648-4fc13cba4d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:19.959704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47e4d1-d177-42f7-b648-4fc13cba4d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:19.959977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47e4d1-d177-42f7-b648-4fc13cba4d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:19.960239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47e4d1-d177-42f7-b648-4fc13cba4d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:19.961842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bb47e4d1-d177-42f7-b648-4fc13cba4d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:20.031023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:20.068934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47e4d1-d177-42f7-b648-4fc13cba4d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:20.070380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47e4d1-d177-42f7-b648-4fc13cba4d18 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:20.087824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 495/1000] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:22.298322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055dc2d-ff6d-42d1-ad1e-8be046d1b577 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:22.298851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055dc2d-ff6d-42d1-ad1e-8be046d1b577 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:22.298851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055dc2d-ff6d-42d1-ad1e-8be046d1b577 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:22.300232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 506/1001] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:22.305573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe30a1-41e7-44f0-a17c-87af993d3f7c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:22.305992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe30a1-41e7-44f0-a17c-87af993d3f7c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:22.306121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe30a1-41e7-44f0-a17c-87af993d3f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:22.371699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-79fe30a1-41e7-44f0-a17c-87af993d3f7c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:22.372875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-79fe30a1-41e7-44f0-a17c-87af993d3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:22.478392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 496/1002] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:22.777447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48634-fc52-48fc-8c4b-13a152f9c1f4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:22.777844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48634-fc52-48fc-8c4b-13a152f9c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:22.778183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48634-fc52-48fc-8c4b-13a152f9c1f4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:22.779627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 507/1003] 10.222.0.25 () {54 vars in 964 bytes} [Sun Oct 23 02:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:22.785715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125643-390c-4bbf-9e1c-e398d66bb339 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:22.786002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125643-390c-4bbf-9e1c-e398d66bb339 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:22.786270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125643-390c-4bbf-9e1c-e398d66bb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:22.817464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:22.862642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0e125643-390c-4bbf-9e1c-e398d66bb339 None None] MFA Rules not processed for user `1dc28ef7b36746208560692b17809e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:22.863837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e125643-390c-4bbf-9e1c-e398d66bb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:22.939505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 497/1004] 10.222.0.25 () {58 vars in 1061 bytes} [Sun Oct 23 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:22.948379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48634-fc52-48fc-8c4b-13a152f9c1f4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:22.949928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-74c48634-fc52-48fc-8c4b-13a152f9c1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:23.052210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48634-fc52-48fc-8c4b-13a152f9c1f4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:23.134029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca9f5d-4f2f-48da-9847-cb37ef8cf84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:23.134640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca9f5d-4f2f-48da-9847-cb37ef8cf84c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:23.134914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca9f5d-4f2f-48da-9847-cb37ef8cf84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:23.135179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca9f5d-4f2f-48da-9847-cb37ef8cf84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:23.136747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-faca9f5d-4f2f-48da-9847-cb37ef8cf84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:23.153655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:23.246004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca9f5d-4f2f-48da-9847-cb37ef8cf84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:23.247571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca9f5d-4f2f-48da-9847-cb37ef8cf84c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:23.265902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 508/1005] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:25.710157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086664-f177-4e67-8427-34d6653bee3b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:25.710669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086664-f177-4e67-8427-34d6653bee3b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:25.710838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086664-f177-4e67-8427-34d6653bee3b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:25.712284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 498/1006] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:25.718149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b604-1c7a-4ce4-be1e-74440e7a7564 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:25.718617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b604-1c7a-4ce4-be1e-74440e7a7564 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:25.718706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b604-1c7a-4ce4-be1e-74440e7a7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:25.790370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-96f5b604-1c7a-4ce4-be1e-74440e7a7564 None None] MFA Rules not processed for user `717327774a4146f69129e15672f31b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:25.791581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-96f5b604-1c7a-4ce4-be1e-74440e7a7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:25.859167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:25.892051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 509/1007] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:26.175202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086664-f177-4e67-8427-34d6653bee3b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:26.176800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb086664-f177-4e67-8427-34d6653bee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:26.279319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086664-f177-4e67-8427-34d6653bee3b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:26.300579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:26.358867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147901d-041c-4897-bdd1-0a53bcd98aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:26.359470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147901d-041c-4897-bdd1-0a53bcd98aeb service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:26.359744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147901d-041c-4897-bdd1-0a53bcd98aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:26.360009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147901d-041c-4897-bdd1-0a53bcd98aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:26.361647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0147901d-041c-4897-bdd1-0a53bcd98aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:26.478110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147901d-041c-4897-bdd1-0a53bcd98aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:26.479737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147901d-041c-4897-bdd1-0a53bcd98aeb service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:26.499936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 499/1008] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:29.035165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6ced-ab94-4410-ae02-e97f6a22b355 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:29.035693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6ced-ab94-4410-ae02-e97f6a22b355 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:29.035693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6ced-ab94-4410-ae02-e97f6a22b355 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:29.037225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 510/1009] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:29.042459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20d362-bf03-4d1b-b96a-e66610e7ad60 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:29.042880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20d362-bf03-4d1b-b96a-e66610e7ad60 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:29.043003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20d362-bf03-4d1b-b96a-e66610e7ad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:29.105858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:29.109167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4c20d362-bf03-4d1b-b96a-e66610e7ad60 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:29.110897 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4c20d362-bf03-4d1b-b96a-e66610e7ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:29.205325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 500/1010] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:29.485813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd6ced-ab94-4410-ae02-e97f6a22b355 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:29.487361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d3dd6ced-ab94-4410-ae02-e97f6a22b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:29.586639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd6ced-ab94-4410-ae02-e97f6a22b355 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:29.661656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25729f-2d54-41da-bb53-b0c5a2dce0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:29.662262 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25729f-2d54-41da-bb53-b0c5a2dce0ff service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:29.662541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25729f-2d54-41da-bb53-b0c5a2dce0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:29.662811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25729f-2d54-41da-bb53-b0c5a2dce0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:29.664400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2f25729f-2d54-41da-bb53-b0c5a2dce0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:29.690975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:29.772620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25729f-2d54-41da-bb53-b0c5a2dce0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:29.774006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25729f-2d54-41da-bb53-b0c5a2dce0ff service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:29.792059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 511/1011] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:31.990041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0e0df-5f6b-4a01-893f-979f9c1f9eed None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:31.990707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0e0df-5f6b-4a01-893f-979f9c1f9eed None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:31.990707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0e0df-5f6b-4a01-893f-979f9c1f9eed None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:31.991938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 501/1012] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:31.997263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b196a-9bdc-42c3-bed8-ee08a3882e66 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:31.997656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b196a-9bdc-42c3-bed8-ee08a3882e66 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:31.997816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b196a-9bdc-42c3-bed8-ee08a3882e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:32.062455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-086b196a-9bdc-42c3-bed8-ee08a3882e66 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:32.063632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-086b196a-9bdc-42c3-bed8-ee08a3882e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:32.136575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:32.159806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 512/1013] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:32.447345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0e0df-5f6b-4a01-893f-979f9c1f9eed None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:32.448878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-36f0e0df-5f6b-4a01-893f-979f9c1f9eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:32.552050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0e0df-5f6b-4a01-893f-979f9c1f9eed None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:32.580574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:32.624813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d99245-351d-4c22-9b97-cf0e50a3872e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:32.625365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99245-351d-4c22-9b97-cf0e50a3872e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:32.625637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99245-351d-4c22-9b97-cf0e50a3872e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:32.625899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99245-351d-4c22-9b97-cf0e50a3872e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:32.627458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d9d99245-351d-4c22-9b97-cf0e50a3872e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:32.734122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d99245-351d-4c22-9b97-cf0e50a3872e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:32.735513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d99245-351d-4c22-9b97-cf0e50a3872e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:32.754248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 502/1014] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:35.365269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53316e-a984-411d-8d7b-9f3c01aa0042 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:35.365806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53316e-a984-411d-8d7b-9f3c01aa0042 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:35.365806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53316e-a984-411d-8d7b-9f3c01aa0042 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:35.367163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 513/1015] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:35.372864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5c21-c20d-4670-94c3-cbcebb83f3f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:35.373360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5c21-c20d-4670-94c3-cbcebb83f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:35.373474 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5c21-c20d-4670-94c3-cbcebb83f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:35.437783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2b2b5c21-c20d-4670-94c3-cbcebb83f3f9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:35.438980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2b2b5c21-c20d-4670-94c3-cbcebb83f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:35.447154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:35.534334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 503/1016] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:35.820778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53316e-a984-411d-8d7b-9f3c01aa0042 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:35.822322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fb53316e-a984-411d-8d7b-9f3c01aa0042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:35.923633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53316e-a984-411d-8d7b-9f3c01aa0042 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:35.996956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2bd24-f5d0-472f-80ee-91818397f64d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:35.997583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2bd24-f5d0-472f-80ee-91818397f64d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:35.997865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2bd24-f5d0-472f-80ee-91818397f64d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:35.998140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2bd24-f5d0-472f-80ee-91818397f64d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:35.999719 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d8a2bd24-f5d0-472f-80ee-91818397f64d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:36.034926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:36.107375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2bd24-f5d0-472f-80ee-91818397f64d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:36.108748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2bd24-f5d0-472f-80ee-91818397f64d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:36.126928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 514/1017] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:40.284322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0407d79-dfae-43ed-9d89-b5d0a6023f39 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:40.284820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0407d79-dfae-43ed-9d89-b5d0a6023f39 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:40.284820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0407d79-dfae-43ed-9d89-b5d0a6023f39 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:40.286172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 504/1018] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:40.291347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd2f11-1b1a-4201-81bf-8efed06781ca None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:40.291765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd2f11-1b1a-4201-81bf-8efed06781ca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:40.291900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd2f11-1b1a-4201-81bf-8efed06781ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:40.358038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b2fd2f11-1b1a-4201-81bf-8efed06781ca None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:40.359155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2fd2f11-1b1a-4201-81bf-8efed06781ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:40.443369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:40.455347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 515/1019] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:40.737127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0407d79-dfae-43ed-9d89-b5d0a6023f39 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:40.738664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d0407d79-dfae-43ed-9d89-b5d0a6023f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:40.843856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0407d79-dfae-43ed-9d89-b5d0a6023f39 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:40.883067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:40.920995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263b5cf-7365-4616-989d-ca0187eb1302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:40.921608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b5cf-7365-4616-989d-ca0187eb1302 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:40.921892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b5cf-7365-4616-989d-ca0187eb1302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:40.922163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b5cf-7365-4616-989d-ca0187eb1302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:40.923773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3263b5cf-7365-4616-989d-ca0187eb1302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:41.034315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263b5cf-7365-4616-989d-ca0187eb1302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:41.035677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263b5cf-7365-4616-989d-ca0187eb1302 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:41.054628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 505/1020] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:43.827129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a94c-38c9-457a-bb53-aa5327ad4582 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:43.827699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a94c-38c9-457a-bb53-aa5327ad4582 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:43.827699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a94c-38c9-457a-bb53-aa5327ad4582 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:43.829309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 516/1021] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:43.834279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748c2ab-445b-450d-b625-c4c385966676 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:43.834719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748c2ab-445b-450d-b625-c4c385966676 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:43.834861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748c2ab-445b-450d-b625-c4c385966676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:43.900574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1748c2ab-445b-450d-b625-c4c385966676 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:43.901822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1748c2ab-445b-450d-b625-c4c385966676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:43.920777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:44.000343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 506/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:44.283900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a94c-38c9-457a-bb53-aa5327ad4582 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:44.285522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8660a94c-38c9-457a-bb53-aa5327ad4582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:44.394971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a94c-38c9-457a-bb53-aa5327ad4582 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:44.469455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9705b-f0fa-456e-b149-146db6bde573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:44.470067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9705b-f0fa-456e-b149-146db6bde573 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:44.470347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9705b-f0fa-456e-b149-146db6bde573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:44.470614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9705b-f0fa-456e-b149-146db6bde573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:44.472194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f7d9705b-f0fa-456e-b149-146db6bde573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:44.515407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:44.584906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9705b-f0fa-456e-b149-146db6bde573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:44.586367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9705b-f0fa-456e-b149-146db6bde573 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:44.605181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 517/1023] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:48.692462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a34ef4-84dd-46b4-8ec4-14dd07c0b18b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:48.693039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a34ef4-84dd-46b4-8ec4-14dd07c0b18b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:48.693039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a34ef4-84dd-46b4-8ec4-14dd07c0b18b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:48.694463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 507/1024] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:48.699747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b45ac-97b2-4df1-89d3-9f6f7bec995d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:48.700151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b45ac-97b2-4df1-89d3-9f6f7bec995d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:48.700285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b45ac-97b2-4df1-89d3-9f6f7bec995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:48.771537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-788b45ac-97b2-4df1-89d3-9f6f7bec995d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:48.772749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-788b45ac-97b2-4df1-89d3-9f6f7bec995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:48.867837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:48.870218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 518/1025] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:49.151220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a34ef4-84dd-46b4-8ec4-14dd07c0b18b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:49.153369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d7a34ef4-84dd-46b4-8ec4-14dd07c0b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:49.254797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a34ef4-84dd-46b4-8ec4-14dd07c0b18b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:49.303789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:49.334779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84314eb9-7432-4e40-bc0d-7535c6632bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:49.335657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314eb9-7432-4e40-bc0d-7535c6632bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:49.335936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314eb9-7432-4e40-bc0d-7535c6632bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:49.336207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314eb9-7432-4e40-bc0d-7535c6632bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:49.337857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-84314eb9-7432-4e40-bc0d-7535c6632bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:49.451732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84314eb9-7432-4e40-bc0d-7535c6632bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:49.453209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84314eb9-7432-4e40-bc0d-7535c6632bc6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:49.471702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 508/1026] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:54.331682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c5b17-3337-4bf0-9a98-d05476168c5e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:54.332090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c5b17-3337-4bf0-9a98-d05476168c5e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:54.332271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c5b17-3337-4bf0-9a98-d05476168c5e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:54.333610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 519/1027] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:54.347699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3ed1-8db8-4725-ada2-df235e931172 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:54.347699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3ed1-8db8-4725-ada2-df235e931172 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:54.347699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3ed1-8db8-4725-ada2-df235e931172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:54.468207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-00af3ed1-8db8-4725-ada2-df235e931172 None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:54.471264 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-00af3ed1-8db8-4725-ada2-df235e931172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:54.500457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:54.600955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 509/1028] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:03:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:58.764541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84267813-d276-4bfa-9d17-ca7aca0a6be1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:58.765363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84267813-d276-4bfa-9d17-ca7aca0a6be1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:58.765363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84267813-d276-4bfa-9d17-ca7aca0a6be1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:58.766585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 520/1029] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:03:58.771548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19217b-edca-4dde-b9d9-2ac0474e2cd9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:58.772011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19217b-edca-4dde-b9d9-2ac0474e2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:58.772302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19217b-edca-4dde-b9d9-2ac0474e2cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:58.852386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8b19217b-edca-4dde-b9d9-2ac0474e2cd9 None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:58.853936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8b19217b-edca-4dde-b9d9-2ac0474e2cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:58.928634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:58.967288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 510/1030] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:03:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:00.317302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ab72-d2be-47e9-8604-40fbf28ddbd7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:00.317831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ab72-d2be-47e9-8604-40fbf28ddbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:00.317948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ab72-d2be-47e9-8604-40fbf28ddbd7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:00.319266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 521/1031] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:00.325234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83766-27a3-41de-a828-8289a2bf2aeb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:00.325695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83766-27a3-41de-a828-8289a2bf2aeb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:00.325807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83766-27a3-41de-a828-8289a2bf2aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:00.402974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c4b83766-27a3-41de-a828-8289a2bf2aeb None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:00.404088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c4b83766-27a3-41de-a828-8289a2bf2aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:00.512156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 511/1032] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:04.010561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109c1ee-3f45-4f38-96eb-2bdc594fe357 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:04.011157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109c1ee-3f45-4f38-96eb-2bdc594fe357 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:04.011157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109c1ee-3f45-4f38-96eb-2bdc594fe357 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:04.012584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 522/1033] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:04.018059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b94025-c2d2-4afe-a811-63e972322e03 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:04.018496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b94025-c2d2-4afe-a811-63e972322e03 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:04.018584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b94025-c2d2-4afe-a811-63e972322e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:04.058732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:04.091806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-66b94025-c2d2-4afe-a811-63e972322e03 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:04.092904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-66b94025-c2d2-4afe-a811-63e972322e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:04.201724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 512/1034] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:04.529438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802730fd-a65b-455e-ba1a-4cee4b3b29d9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:04.529854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802730fd-a65b-455e-ba1a-4cee4b3b29d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:04.530155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802730fd-a65b-455e-ba1a-4cee4b3b29d9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:04.532700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 523/1035] 10.222.0.25 () {54 vars in 961 bytes} [Sun Oct 23 02:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:04.545377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bc647-5f79-4fda-9d5c-7417bd9a4b17 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:04.545849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bc647-5f79-4fda-9d5c-7417bd9a4b17 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:04.546319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bc647-5f79-4fda-9d5c-7417bd9a4b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:04.633329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6a5bc647-5f79-4fda-9d5c-7417bd9a4b17 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:04.634679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6a5bc647-5f79-4fda-9d5c-7417bd9a4b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:04.689102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:04.764191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 513/1036] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Oct 23 02:04:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:04:04.772427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802730fd-a65b-455e-ba1a-4cee4b3b29d9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:04.773977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-802730fd-a65b-455e-ba1a-4cee4b3b29d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:04.930882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802730fd-a65b-455e-ba1a-4cee4b3b29d9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:05.011180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:05.055161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba6c02-9dc5-44c6-a375-b9c63d489349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:05.055829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6c02-9dc5-44c6-a375-b9c63d489349 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:05.056138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6c02-9dc5-44c6-a375-b9c63d489349 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:05.056409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba6c02-9dc5-44c6-a375-b9c63d489349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:05.058073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5bba6c02-9dc5-44c6-a375-b9c63d489349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:05.162339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba6c02-9dc5-44c6-a375-b9c63d489349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:05.164262 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba6c02-9dc5-44c6-a375-b9c63d489349 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:05.184726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 524/1037] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:04:07.585164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef56e2-d816-4614-bcb7-42b3d7c7be2f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:07.585164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef56e2-d816-4614-bcb7-42b3d7c7be2f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:07.585164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef56e2-d816-4614-bcb7-42b3d7c7be2f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:07.588112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 514/1038] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:07.601638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5e18-be5b-4c0d-9953-da3ca03030d9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:07.602049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5e18-be5b-4c0d-9953-da3ca03030d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:07.603502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5e18-be5b-4c0d-9953-da3ca03030d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:07.677977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0f0c5e18-be5b-4c0d-9953-da3ca03030d9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:07.679284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f0c5e18-be5b-4c0d-9953-da3ca03030d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:07.722019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:07.788545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 525/1039] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:08.086236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef56e2-d816-4614-bcb7-42b3d7c7be2f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:08.087876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-36ef56e2-d816-4614-bcb7-42b3d7c7be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:08.277171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef56e2-d816-4614-bcb7-42b3d7c7be2f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:08.288409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:08.408098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00abb76-a5d3-49b8-896b-05e98960edfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:08.408705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00abb76-a5d3-49b8-896b-05e98960edfb service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:08.409009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00abb76-a5d3-49b8-896b-05e98960edfb service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:08.409273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00abb76-a5d3-49b8-896b-05e98960edfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:08.410855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c00abb76-a5d3-49b8-896b-05e98960edfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:08.503598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00abb76-a5d3-49b8-896b-05e98960edfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:08.505212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00abb76-a5d3-49b8-896b-05e98960edfb service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:08.523938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 515/1040] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:11.020422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2dd8-39c7-481f-a47b-4f06ef0ce914 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:11.021443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2dd8-39c7-481f-a47b-4f06ef0ce914 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:11.021825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2dd8-39c7-481f-a47b-4f06ef0ce914 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:11.023503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 526/1041] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:11.028857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4d16-38b5-4c5b-9628-3ea81c13fd3c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:11.029320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4d16-38b5-4c5b-9628-3ea81c13fd3c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:11.029415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4d16-38b5-4c5b-9628-3ea81c13fd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:11.045544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:11.098929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d51d4d16-38b5-4c5b-9628-3ea81c13fd3c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:11.100117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d51d4d16-38b5-4c5b-9628-3ea81c13fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:11.211635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 516/1042] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:11.503951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a099c4-65f8-4248-860f-df44f1870e40 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:11.504249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a099c4-65f8-4248-860f-df44f1870e40 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:11.504504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a099c4-65f8-4248-860f-df44f1870e40 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:11.506042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 527/1043] 10.222.0.25 () {54 vars in 961 bytes} [Sun Oct 23 02:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:11.512039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1695fa-49d0-4089-8c51-aa8435912e86 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:11.512325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1695fa-49d0-4089-8c51-aa8435912e86 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:11.512595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1695fa-49d0-4089-8c51-aa8435912e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:11.590669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bb1695fa-49d0-4089-8c51-aa8435912e86 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:11.591745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bb1695fa-49d0-4089-8c51-aa8435912e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:11.628927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:11.713822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 517/1044] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Oct 23 02:04:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:11.721780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a099c4-65f8-4248-860f-df44f1870e40 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:11.723273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97a099c4-65f8-4248-860f-df44f1870e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:11.874201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a099c4-65f8-4248-860f-df44f1870e40 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:11.896304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:11.999045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5497a-0c19-4968-9e00-bb9883a6c3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:11.999651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5497a-0c19-4968-9e00-bb9883a6c3e7 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:11.999924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5497a-0c19-4968-9e00-bb9883a6c3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:12.000190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5497a-0c19-4968-9e00-bb9883a6c3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:12.001798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9ec5497a-0c19-4968-9e00-bb9883a6c3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:12.100952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5497a-0c19-4968-9e00-bb9883a6c3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:12.102559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5497a-0c19-4968-9e00-bb9883a6c3e7 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:12.126492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 528/1045] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:12.142255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6f547-3c82-49c5-b471-fd14dcae5b25 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:12.142700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6f547-3c82-49c5-b471-fd14dcae5b25 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:12.142801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6f547-3c82-49c5-b471-fd14dcae5b25 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:12.144257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 518/1046] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:12.149351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915744-f24a-493a-9375-03d8cdbfe590 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:12.149651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915744-f24a-493a-9375-03d8cdbfe590 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:12.149918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915744-f24a-493a-9375-03d8cdbfe590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:12.187896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:12.229323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-46915744-f24a-493a-9375-03d8cdbfe590 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:12.230628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-46915744-f24a-493a-9375-03d8cdbfe590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:12.356716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 529/1047] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:12.701584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af84b0-9f18-4416-9cbf-2c6dd4e95411 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:12.701862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af84b0-9f18-4416-9cbf-2c6dd4e95411 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:12.702138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af84b0-9f18-4416-9cbf-2c6dd4e95411 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:12.703643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 519/1048] 10.222.0.25 () {54 vars in 963 bytes} [Sun Oct 23 02:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:12.708585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fcd3-88a1-43bc-87ac-4b9bfa0b5a3d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:12.708943 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fcd3-88a1-43bc-87ac-4b9bfa0b5a3d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:12.709440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fcd3-88a1-43bc-87ac-4b9bfa0b5a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:12.792722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-af35fcd3-88a1-43bc-87ac-4b9bfa0b5a3d None None] MFA Rules not processed for user `f681d888b56c4fea8acd271e1d51ae3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:12.794093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-af35fcd3-88a1-43bc-87ac-4b9bfa0b5a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:12.846209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:12.878342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 530/1049] 10.222.0.25 () {58 vars in 1060 bytes} [Sun Oct 23 02:04:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:12.885969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af84b0-9f18-4416-9cbf-2c6dd4e95411 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:12.887474 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-63af84b0-9f18-4416-9cbf-2c6dd4e95411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:12.998275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af84b0-9f18-4416-9cbf-2c6dd4e95411 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:13.043620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:13.080907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255023ec-01d7-4a85-8421-b7973873a3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:13.081619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255023ec-01d7-4a85-8421-b7973873a3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:13.081967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255023ec-01d7-4a85-8421-b7973873a3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:13.082308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255023ec-01d7-4a85-8421-b7973873a3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:13.084049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-255023ec-01d7-4a85-8421-b7973873a3a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:13.229821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255023ec-01d7-4a85-8421-b7973873a3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:13.231365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255023ec-01d7-4a85-8421-b7973873a3a7 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:13.249956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 520/1050] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:04:14.366875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1b3bb-4f32-4f37-b65b-7837d5939fbb None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:14.367431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1b3bb-4f32-4f37-b65b-7837d5939fbb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:14.367431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1b3bb-4f32-4f37-b65b-7837d5939fbb None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:14.368859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 531/1051] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:14.374731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a140b-c12b-4f32-8207-8f98c682823a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:14.375136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a140b-c12b-4f32-8207-8f98c682823a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:14.375348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a140b-c12b-4f32-8207-8f98c682823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:14.440352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f98a140b-c12b-4f32-8207-8f98c682823a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:14.441566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f98a140b-c12b-4f32-8207-8f98c682823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:14.462337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:14.540693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 521/1052] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:04:14.834356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1b3bb-4f32-4f37-b65b-7837d5939fbb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:14.835938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ffe1b3bb-4f32-4f37-b65b-7837d5939fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:14.985072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1b3bb-4f32-4f37-b65b-7837d5939fbb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:15.037311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:15.101435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175e210-972d-4454-bbe5-b69157356de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:15.102041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e210-972d-4454-bbe5-b69157356de3 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:15.102313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e210-972d-4454-bbe5-b69157356de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:15.102581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e210-972d-4454-bbe5-b69157356de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:15.104749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0175e210-972d-4454-bbe5-b69157356de3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:15.200481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175e210-972d-4454-bbe5-b69157356de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:15.202124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175e210-972d-4454-bbe5-b69157356de3 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:15.221022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 532/1053] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:17.438833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0c17f-b530-4365-8bbb-6a59a6e0b009 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:17.439444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0c17f-b530-4365-8bbb-6a59a6e0b009 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:17.439444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0c17f-b530-4365-8bbb-6a59a6e0b009 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:17.440717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 522/1054] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:17.446144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa393-0469-4e00-8677-4e4ec8c9738b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:17.446618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa393-0469-4e00-8677-4e4ec8c9738b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:17.446713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa393-0469-4e00-8677-4e4ec8c9738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:17.521297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-886fa393-0469-4e00-8677-4e4ec8c9738b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:17.522494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-886fa393-0469-4e00-8677-4e4ec8c9738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:17.530101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:17.626758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 533/1055] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:04:17.915471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0c17f-b530-4365-8bbb-6a59a6e0b009 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:17.917014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0bc0c17f-b530-4365-8bbb-6a59a6e0b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:18.068722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0c17f-b530-4365-8bbb-6a59a6e0b009 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:18.073253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:18.196935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec005f91-044f-48f0-95b0-a735b73c28d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:18.197654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005f91-044f-48f0-95b0-a735b73c28d2 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:18.198001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005f91-044f-48f0-95b0-a735b73c28d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:18.198339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005f91-044f-48f0-95b0-a735b73c28d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:18.200027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ec005f91-044f-48f0-95b0-a735b73c28d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:18.298750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec005f91-044f-48f0-95b0-a735b73c28d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:18.300517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec005f91-044f-48f0-95b0-a735b73c28d2 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:18.319965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 523/1056] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:20.544215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e0e0-5e7d-476b-a330-aa787236eb87 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:20.544876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e0e0-5e7d-476b-a330-aa787236eb87 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:20.544876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e0e0-5e7d-476b-a330-aa787236eb87 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:20.550045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 534/1057] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:20.551304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32870e49-cd3a-4c0e-a956-7cf94ac80084 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:20.551304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32870e49-cd3a-4c0e-a956-7cf94ac80084 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:20.552060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32870e49-cd3a-4c0e-a956-7cf94ac80084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:20.563894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:20.647923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-32870e49-cd3a-4c0e-a956-7cf94ac80084 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:20.649146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-32870e49-cd3a-4c0e-a956-7cf94ac80084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:20.750090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 524/1058] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:04:21.117237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3e0e0-5e7d-476b-a330-aa787236eb87 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:21.118935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-89b3e0e0-5e7d-476b-a330-aa787236eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:21.262652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:21.282882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3e0e0-5e7d-476b-a330-aa787236eb87 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:21.401574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60935fce-bf59-49ad-a86d-378561be4d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:21.402105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935fce-bf59-49ad-a86d-378561be4d43 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:21.402382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935fce-bf59-49ad-a86d-378561be4d43 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:21.402651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935fce-bf59-49ad-a86d-378561be4d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:21.404272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-60935fce-bf59-49ad-a86d-378561be4d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:21.502650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60935fce-bf59-49ad-a86d-378561be4d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:21.504241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60935fce-bf59-49ad-a86d-378561be4d43 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:21.514631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:21.523366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 535/1059] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:23.717275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47f78-63ba-4a1c-a405-3737f3717281 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:23.717948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47f78-63ba-4a1c-a405-3737f3717281 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:23.717948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47f78-63ba-4a1c-a405-3737f3717281 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:23.719175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 525/1060] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:23.724513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dcf2b-04af-422d-b53b-07f2549d3bcb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:23.724954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dcf2b-04af-422d-b53b-07f2549d3bcb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:23.725094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dcf2b-04af-422d-b53b-07f2549d3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:23.793929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-456dcf2b-04af-422d-b53b-07f2549d3bcb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:23.795128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-456dcf2b-04af-422d-b53b-07f2549d3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:23.908421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 536/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:24.196796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee47f78-63ba-4a1c-a405-3737f3717281 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:24.198408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2ee47f78-63ba-4a1c-a405-3737f3717281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:24.286292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:24.351909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee47f78-63ba-4a1c-a405-3737f3717281 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:24.483452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb6577-8a9c-41b1-92ce-951925f60b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:24.484060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6577-8a9c-41b1-92ce-951925f60b9c service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:24.484335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6577-8a9c-41b1-92ce-951925f60b9c service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:24.484595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6577-8a9c-41b1-92ce-951925f60b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:24.486230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-59fb6577-8a9c-41b1-92ce-951925f60b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:24.541799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:24.584195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb6577-8a9c-41b1-92ce-951925f60b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:24.585836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb6577-8a9c-41b1-92ce-951925f60b9c service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:24.604719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 526/1062] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:26.781931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7cbd9-d17d-4178-ad0e-5aac8705a564 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:26.782455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7cbd9-d17d-4178-ad0e-5aac8705a564 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:26.782455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7cbd9-d17d-4178-ad0e-5aac8705a564 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:26.783739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 537/1063] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:26.789068 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fad2-8cc9-4e78-b037-01a9a4992a1a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:26.789514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fad2-8cc9-4e78-b037-01a9a4992a1a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:26.789619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fad2-8cc9-4e78-b037-01a9a4992a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:26.855688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0c77fad2-8cc9-4e78-b037-01a9a4992a1a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:26.856889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0c77fad2-8cc9-4e78-b037-01a9a4992a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:26.959468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 527/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:27.249889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7cbd9-d17d-4178-ad0e-5aac8705a564 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:27.251429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17c7cbd9-d17d-4178-ad0e-5aac8705a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:27.327097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:27.398915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7cbd9-d17d-4178-ad0e-5aac8705a564 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:27.523387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0b6ab-4299-42da-9af1-50ba51ade644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:27.524001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b6ab-4299-42da-9af1-50ba51ade644 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:27.524278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b6ab-4299-42da-9af1-50ba51ade644 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:27.525123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0b6ab-4299-42da-9af1-50ba51ade644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:27.526708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6ae0b6ab-4299-42da-9af1-50ba51ade644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:27.568347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:27.625585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0b6ab-4299-42da-9af1-50ba51ade644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:27.627118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0b6ab-4299-42da-9af1-50ba51ade644 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:27.647394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 538/1065] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:28.398488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5aa00-8432-44e6-9273-a11706a744a8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:28.399038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5aa00-8432-44e6-9273-a11706a744a8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:28.399038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5aa00-8432-44e6-9273-a11706a744a8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:28.400465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 528/1066] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:28.405939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e216-055a-469e-8853-d334e390dbe2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:28.406380 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e216-055a-469e-8853-d334e390dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:28.406482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e216-055a-469e-8853-d334e390dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:28.472119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bec6e216-055a-469e-8853-d334e390dbe2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:28.473379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bec6e216-055a-469e-8853-d334e390dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:28.572373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 539/1067] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:28.877750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85bd16-a92b-4bc1-a088-297d4d66b322 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:28.878112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85bd16-a92b-4bc1-a088-297d4d66b322 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:28.878459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85bd16-a92b-4bc1-a088-297d4d66b322 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:28.879869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 529/1068] 10.222.0.25 () {54 vars in 962 bytes} [Sun Oct 23 02:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:28.885163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774797f-82d1-4f51-bc06-6f2981066580 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:28.885453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774797f-82d1-4f51-bc06-6f2981066580 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:28.885748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774797f-82d1-4f51-bc06-6f2981066580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:28.901790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:28.964665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0774797f-82d1-4f51-bc06-6f2981066580 None None] MFA Rules not processed for user `a17dda73b3ad4896a282dbd1b4cc8bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:28.965881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0774797f-82d1-4f51-bc06-6f2981066580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:29.041379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 540/1069] 10.222.0.25 () {58 vars in 1059 bytes} [Sun Oct 23 02:04:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:29.049116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85bd16-a92b-4bc1-a088-297d4d66b322 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:29.050604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fe85bd16-a92b-4bc1-a088-297d4d66b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:29.081377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:29.158429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85bd16-a92b-4bc1-a088-297d4d66b322 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:29.233314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbe054-9f40-4566-9484-df4b140e1e90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:29.233929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe054-9f40-4566-9484-df4b140e1e90 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:29.234209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe054-9f40-4566-9484-df4b140e1e90 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:29.234487 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe054-9f40-4566-9484-df4b140e1e90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:29.236070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bccbe054-9f40-4566-9484-df4b140e1e90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:29.315302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:29.347939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbe054-9f40-4566-9484-df4b140e1e90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:29.349405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbe054-9f40-4566-9484-df4b140e1e90 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:29.368604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 530/1070] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:29.852461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156ca5-6145-4471-9ed0-d7d04227adaa None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:29.853076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156ca5-6145-4471-9ed0-d7d04227adaa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:29.853076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156ca5-6145-4471-9ed0-d7d04227adaa None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:29.854480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 541/1071] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:29.859774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:29.860203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:29.860320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:29.930900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:29.932151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:30.034469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 531/1072] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:30.113124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e38e0-9933-452c-af54-d88e8dc2fa3f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:30.113481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e38e0-9933-452c-af54-d88e8dc2fa3f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:30.113831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e38e0-9933-452c-af54-d88e8dc2fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:30.182724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-559e38e0-9933-452c-af54-d88e8dc2fa3f None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:30.183832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-559e38e0-9933-452c-af54-d88e8dc2fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:30.251321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:30.282370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 542/1073] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:04:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:30.324904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:30.326153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:30.328664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768993cc-beb1-4c04-8a15-ceda4fb609a0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:30.328955 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768993cc-beb1-4c04-8a15-ceda4fb609a0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:30.329266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768993cc-beb1-4c04-8a15-ceda4fb609a0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:30.330643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 543/1074] 10.222.0.25 () {54 vars in 943 bytes} [Sun Oct 23 02:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 02:04:30.337327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4b9c-8f56-4145-b468-3ac74ec564d5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:30.337615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4b9c-8f56-4145-b468-3ac74ec564d5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:30.337888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4b9c-8f56-4145-b468-3ac74ec564d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:30.367051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:30.414352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-242f4b9c-8f56-4145-b468-3ac74ec564d5 None None] MFA Rules not processed for user `349cd8f8431a43a698e9cb4e3536f59a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:30.416165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-242f4b9c-8f56-4145-b468-3ac74ec564d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:30.442223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0781347-0d92-43e2-a157-983261d3a890 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:30.521936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 544/1075] 10.222.0.25 () {58 vars in 1040 bytes} [Sun Oct 23 02:04:30 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:30.531448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f4b9c-8f56-4145-b468-3ac74ec564d5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:30.541595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f4b9c-8f56-4145-b468-3ac74ec564d5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:30.555865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7792b-bf52-4526-b2ed-4749048be432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:30.556472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7792b-bf52-4526-b2ed-4749048be432 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:30.556754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7792b-bf52-4526-b2ed-4749048be432 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:30.557042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7792b-bf52-4526-b2ed-4749048be432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:30.558633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-44b7792b-bf52-4526-b2ed-4749048be432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:30.566458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:30.593976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:30.651423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7792b-bf52-4526-b2ed-4749048be432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:30.651752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c70c4-ef36-4b6e-bf57-508b64c9a4c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:30.652361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c70c4-ef36-4b6e-bf57-508b64c9a4c2 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:30.652639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c70c4-ef36-4b6e-bf57-508b64c9a4c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:30.652909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c70c4-ef36-4b6e-bf57-508b64c9a4c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:30.653062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7792b-bf52-4526-b2ed-4749048be432 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:30.654563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a84c70c4-ef36-4b6e-bf57-508b64c9a4c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:30.671269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 532/1076] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:30.743560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c70c4-ef36-4b6e-bf57-508b64c9a4c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:30.745246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c70c4-ef36-4b6e-bf57-508b64c9a4c2 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:30.754527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 545/1077] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 02:04:32.879301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee0ba-1c50-4f14-9bcf-c16072713922 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:32.879913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee0ba-1c50-4f14-9bcf-c16072713922 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:32.879913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee0ba-1c50-4f14-9bcf-c16072713922 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:32.881226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 533/1078] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:32.886599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3af3b-2bd8-41c2-ad2c-bb2cd50452f7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:32.887021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3af3b-2bd8-41c2-ad2c-bb2cd50452f7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:32.887162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3af3b-2bd8-41c2-ad2c-bb2cd50452f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:32.991573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-20a3af3b-2bd8-41c2-ad2c-bb2cd50452f7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:32.992937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20a3af3b-2bd8-41c2-ad2c-bb2cd50452f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:33.001245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:33.127014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 546/1079] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:33.418265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee0ba-1c50-4f14-9bcf-c16072713922 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:33.419819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-720ee0ba-1c50-4f14-9bcf-c16072713922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:33.579621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee0ba-1c50-4f14-9bcf-c16072713922 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:33.593039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:33.705150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6a424-efdd-4437-8ab3-3913203bf032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:33.705770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6a424-efdd-4437-8ab3-3913203bf032 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:33.706051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6a424-efdd-4437-8ab3-3913203bf032 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:33.706328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6a424-efdd-4437-8ab3-3913203bf032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:33.707946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c1f6a424-efdd-4437-8ab3-3913203bf032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:33.806569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6a424-efdd-4437-8ab3-3913203bf032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:33.808190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6a424-efdd-4437-8ab3-3913203bf032 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:33.829176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 534/1080] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:36.064234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525fc4-d166-4e3b-b298-bd1450554e71 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:36.064751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525fc4-d166-4e3b-b298-bd1450554e71 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:36.064751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525fc4-d166-4e3b-b298-bd1450554e71 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:36.066352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 547/1081] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:36.071700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29529c49-bf6d-4850-b047-41ac2dcc47ad None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:36.072126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29529c49-bf6d-4850-b047-41ac2dcc47ad None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:36.072315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29529c49-bf6d-4850-b047-41ac2dcc47ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:36.093560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:36.152967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-29529c49-bf6d-4850-b047-41ac2dcc47ad None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:36.154739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-29529c49-bf6d-4850-b047-41ac2dcc47ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:36.267841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 535/1082] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:36.556431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525fc4-d166-4e3b-b298-bd1450554e71 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:36.557987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f7525fc4-d166-4e3b-b298-bd1450554e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:36.715134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:36.726387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525fc4-d166-4e3b-b298-bd1450554e71 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:36.850862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25d7b8-0203-48ca-b812-f89ce6429c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:36.851496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25d7b8-0203-48ca-b812-f89ce6429c62 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:36.851934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25d7b8-0203-48ca-b812-f89ce6429c62 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:36.852279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25d7b8-0203-48ca-b812-f89ce6429c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:36.853932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd25d7b8-0203-48ca-b812-f89ce6429c62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:36.961524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25d7b8-0203-48ca-b812-f89ce6429c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:36.963128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25d7b8-0203-48ca-b812-f89ce6429c62 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:36.974313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:36.987297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 548/1083] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:39.271202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400f385-454a-46f6-8543-eebd7ffa4b13 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:39.272093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400f385-454a-46f6-8543-eebd7ffa4b13 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:39.272093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400f385-454a-46f6-8543-eebd7ffa4b13 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:39.278447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 536/1084] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:04:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:39.279724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad0035-7667-4029-bf88-cd4a958b1c7f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:39.280166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad0035-7667-4029-bf88-cd4a958b1c7f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:39.280277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad0035-7667-4029-bf88-cd4a958b1c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:39.365261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f0ad0035-7667-4029-bf88-cd4a958b1c7f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:39.370951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f0ad0035-7667-4029-bf88-cd4a958b1c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:39.488949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 549/1085] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:04:39.782585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400f385-454a-46f6-8543-eebd7ffa4b13 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:39.784166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8400f385-454a-46f6-8543-eebd7ffa4b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:39.879843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:39.942091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400f385-454a-46f6-8543-eebd7ffa4b13 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:40.066599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3f9bf-5913-4fa7-b537-40ce656bf365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:40.067111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f9bf-5913-4fa7-b537-40ce656bf365 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:40.067442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f9bf-5913-4fa7-b537-40ce656bf365 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:40.067696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f9bf-5913-4fa7-b537-40ce656bf365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:40.069357 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a6f3f9bf-5913-4fa7-b537-40ce656bf365 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:40.143348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:40.183679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3f9bf-5913-4fa7-b537-40ce656bf365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:40.185328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3f9bf-5913-4fa7-b537-40ce656bf365 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:40.208176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 537/1086] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:49.487795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=67 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:50.205310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=20 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:53.621586 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0612f0-35be-4019-8fca-970e2dd63ace None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:53.622157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0612f0-35be-4019-8fca-970e2dd63ace None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:53.622157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0612f0-35be-4019-8fca-970e2dd63ace None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:53.623551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 550/1087] 10.222.0.25 () {54 vars in 918 bytes} [Sun Oct 23 02:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:53.628943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e828a2-71ad-4b9c-a022-9da0e00833a1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:53.629394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e828a2-71ad-4b9c-a022-9da0e00833a1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:53.629498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e828a2-71ad-4b9c-a022-9da0e00833a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:53.704495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-15e828a2-71ad-4b9c-a022-9da0e00833a1 None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:53.705723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-15e828a2-71ad-4b9c-a022-9da0e00833a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:53.811689 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 538/1088] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Oct 23 02:04:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:53.826076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977feb-4f25-403d-b6d5-cb91b68ab289 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:53.826363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977feb-4f25-403d-b6d5-cb91b68ab289 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:53.826635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977feb-4f25-403d-b6d5-cb91b68ab289 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:53.827964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 551/1089] 10.222.0.25 () {54 vars in 918 bytes} [Sun Oct 23 02:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:53.832269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9283a-f9be-41f5-a648-f7e54d34cd7f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:53.832557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9283a-f9be-41f5-a648-f7e54d34cd7f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:53.832832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9283a-f9be-41f5-a648-f7e54d34cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:53.905051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:53.908052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-63f9283a-f9be-41f5-a648-f7e54d34cd7f None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:53.909867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-63f9283a-f9be-41f5-a648-f7e54d34cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:54.024129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 539/1090] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Oct 23 02:04:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:56.575751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a497c5-303d-43b2-af6d-cae7ea409bdc None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:56.576334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a497c5-303d-43b2-af6d-cae7ea409bdc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:56.576334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a497c5-303d-43b2-af6d-cae7ea409bdc None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:56.577671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 552/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:56.582988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bc4-7503-4d1c-afe1-90f49f923e26 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:56.583430 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bc4-7503-4d1c-afe1-90f49f923e26 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:56.583540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bc4-7503-4d1c-afe1-90f49f923e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:56.648664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-31a17bc4-7503-4d1c-afe1-90f49f923e26 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:56.649887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-31a17bc4-7503-4d1c-afe1-90f49f923e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:56.704506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:56.747207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 540/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:57.032010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a497c5-303d-43b2-af6d-cae7ea409bdc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:57.033750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-33a497c5-303d-43b2-af6d-cae7ea409bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:57.177790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a497c5-303d-43b2-af6d-cae7ea409bdc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:57.249528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:57.289965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582eafc-1e35-42f9-b21c-012506b51314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:57.290515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582eafc-1e35-42f9-b21c-012506b51314 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:57.290794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582eafc-1e35-42f9-b21c-012506b51314 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:57.291064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582eafc-1e35-42f9-b21c-012506b51314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:57.292646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3582eafc-1e35-42f9-b21c-012506b51314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:57.381114 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582eafc-1e35-42f9-b21c-012506b51314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:57.383287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582eafc-1e35-42f9-b21c-012506b51314 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:57.400693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 553/1093] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:04:58.516938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4349-d18a-45f4-a17d-90dd2054b743 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:58.517522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4349-d18a-45f4-a17d-90dd2054b743 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:58.517522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e4349-d18a-45f4-a17d-90dd2054b743 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:58.518833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 541/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:04:58.523716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc2811-41b4-4774-9df3-7ead6da3b7dc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:58.524147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc2811-41b4-4774-9df3-7ead6da3b7dc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:58.524284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc2811-41b4-4774-9df3-7ead6da3b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:58.599843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-20dc2811-41b4-4774-9df3-7ead6da3b7dc None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:04:58.601632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20dc2811-41b4-4774-9df3-7ead6da3b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:58.627572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:58.696538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 554/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:04:58.843707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e4349-d18a-45f4-a17d-90dd2054b743 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:04:58.845214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7b7e4349-d18a-45f4-a17d-90dd2054b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:58.990253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e4349-d18a-45f4-a17d-90dd2054b743 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:04:59.030225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:59.101364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced700eb-54b7-49d2-bec4-e1591614d515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:04:59.101922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced700eb-54b7-49d2-bec4-e1591614d515 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:04:59.102196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced700eb-54b7-49d2-bec4-e1591614d515 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:04:59.102458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced700eb-54b7-49d2-bec4-e1591614d515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:04:59.104015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ced700eb-54b7-49d2-bec4-e1591614d515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:04:59.192446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced700eb-54b7-49d2-bec4-e1591614d515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:04:59.194053 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced700eb-54b7-49d2-bec4-e1591614d515 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:04:59.212425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 542/1096] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:00.316689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cf06-d406-4d71-8321-414b7382d6e2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:00.317298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cf06-d406-4d71-8321-414b7382d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:00.317298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cf06-d406-4d71-8321-414b7382d6e2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:00.318588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 555/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:00.323567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1050-42cc-40a4-95fd-ea33054bd9f7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:00.323988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1050-42cc-40a4-95fd-ea33054bd9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:00.324178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d1050-42cc-40a4-95fd-ea33054bd9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:00.378672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:00.400864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-279d1050-42cc-40a4-95fd-ea33054bd9f7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:00.402109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-279d1050-42cc-40a4-95fd-ea33054bd9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:00.495221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 543/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:00.645346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72cf06-d406-4d71-8321-414b7382d6e2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:00.646794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c72cf06-d406-4d71-8321-414b7382d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:00.788632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72cf06-d406-4d71-8321-414b7382d6e2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:00.800455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:00.901149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661115e-fea7-4316-bfb8-d188f4868277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:00.901678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661115e-fea7-4316-bfb8-d188f4868277 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:00.901956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661115e-fea7-4316-bfb8-d188f4868277 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:00.902228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661115e-fea7-4316-bfb8-d188f4868277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:00.903810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b661115e-fea7-4316-bfb8-d188f4868277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:00.990431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661115e-fea7-4316-bfb8-d188f4868277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:00.992531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661115e-fea7-4316-bfb8-d188f4868277 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:01.010499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 556/1099] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:02.099868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833e88-988b-43bd-b311-890b77961ee3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:02.100948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833e88-988b-43bd-b311-890b77961ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:02.100948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833e88-988b-43bd-b311-890b77961ee3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:02.102263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 544/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:02.107035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33861cd-2322-4a7c-870a-2fb0913481ce None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:02.107466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33861cd-2322-4a7c-870a-2fb0913481ce None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:02.107575 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33861cd-2322-4a7c-870a-2fb0913481ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:02.127503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:02.184082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e33861cd-2322-4a7c-870a-2fb0913481ce None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:02.185294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e33861cd-2322-4a7c-870a-2fb0913481ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:02.278350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 557/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:02.430190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833e88-988b-43bd-b311-890b77961ee3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:02.431633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ad833e88-988b-43bd-b311-890b77961ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:02.540457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:02.576527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833e88-988b-43bd-b311-890b77961ee3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:02.687948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8f0fd-424d-4a6a-b4b4-8fb855dc89b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:02.688575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8f0fd-424d-4a6a-b4b4-8fb855dc89b6 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:02.688852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8f0fd-424d-4a6a-b4b4-8fb855dc89b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:02.689161 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8f0fd-424d-4a6a-b4b4-8fb855dc89b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:02.690742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e0e8f0fd-424d-4a6a-b4b4-8fb855dc89b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:02.767162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:02.781460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8f0fd-424d-4a6a-b4b4-8fb855dc89b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:02.783043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8f0fd-424d-4a6a-b4b4-8fb855dc89b6 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:02.800527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 545/1102] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:03.889724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca40b6-b741-4588-be05-ebf1e9c53515 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:03.890181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca40b6-b741-4588-be05-ebf1e9c53515 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:03.890289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca40b6-b741-4588-be05-ebf1e9c53515 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:03.891639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 558/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:03.896435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a66ae-b450-4ea5-9d21-136659d8ea39 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:03.896862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a66ae-b450-4ea5-9d21-136659d8ea39 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:03.897527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a66ae-b450-4ea5-9d21-136659d8ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:03.972945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4a4a66ae-b450-4ea5-9d21-136659d8ea39 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:03.974170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4a4a66ae-b450-4ea5-9d21-136659d8ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:04.069101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 546/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:04.218813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca40b6-b741-4588-be05-ebf1e9c53515 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:04.220313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4aca40b6-b741-4588-be05-ebf1e9c53515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:04.302620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:04.364280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca40b6-b741-4588-be05-ebf1e9c53515 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:04.474728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b432caf-eab4-4dc7-8ef4-f60a95d49bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:04.475406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432caf-eab4-4dc7-8ef4-f60a95d49bed service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:04.475682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432caf-eab4-4dc7-8ef4-f60a95d49bed service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:04.475952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432caf-eab4-4dc7-8ef4-f60a95d49bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:04.477591 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0b432caf-eab4-4dc7-8ef4-f60a95d49bed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:04.528069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:04.571514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b432caf-eab4-4dc7-8ef4-f60a95d49bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:04.573115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b432caf-eab4-4dc7-8ef4-f60a95d49bed service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:04.591024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 559/1105] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:05.622836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ed7d-df60-4a76-a927-f9754ab9cf80 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:05.623427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ed7d-df60-4a76-a927-f9754ab9cf80 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:05.623427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ed7d-df60-4a76-a927-f9754ab9cf80 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:05.624787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 547/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:05.629583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7bcdc-4ceb-41a6-b5fd-d35b2f3eafe7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:05.629997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7bcdc-4ceb-41a6-b5fd-d35b2f3eafe7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:05.630149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7bcdc-4ceb-41a6-b5fd-d35b2f3eafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:05.704841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b2d7bcdc-4ceb-41a6-b5fd-d35b2f3eafe7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:05.706063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2d7bcdc-4ceb-41a6-b5fd-d35b2f3eafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:05.801021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 560/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:05.951228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ed7d-df60-4a76-a927-f9754ab9cf80 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:05.952812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4988ed7d-df60-4a76-a927-f9754ab9cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:06.001414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:06.096800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ed7d-df60-4a76-a927-f9754ab9cf80 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:06.207229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1e12e-002e-4ecc-927d-b131dd3f1eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:06.207828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e12e-002e-4ecc-927d-b131dd3f1eb3 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:06.208100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e12e-002e-4ecc-927d-b131dd3f1eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:06.208366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e12e-002e-4ecc-927d-b131dd3f1eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:06.210454 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d9a1e12e-002e-4ecc-927d-b131dd3f1eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:06.217488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:06.298956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1e12e-002e-4ecc-927d-b131dd3f1eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:06.300519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1e12e-002e-4ecc-927d-b131dd3f1eb3 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:06.317774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 548/1108] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:07.357921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee9f5-1831-4ddd-be7d-9ced306d6074 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:07.358377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee9f5-1831-4ddd-be7d-9ced306d6074 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:07.358758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee9f5-1831-4ddd-be7d-9ced306d6074 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:07.360113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 561/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:07.365175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7da7-f06c-410a-86bc-51f2a8256924 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:07.366242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7da7-f06c-410a-86bc-51f2a8256924 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:07.366441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7da7-f06c-410a-86bc-51f2a8256924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:07.443254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8cbc7da7-f06c-410a-86bc-51f2a8256924 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:07.444666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8cbc7da7-f06c-410a-86bc-51f2a8256924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:07.521088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:07.551866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 549/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:07.706656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ee9f5-1831-4ddd-be7d-9ced306d6074 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:07.708205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fa4ee9f5-1831-4ddd-be7d-9ced306d6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:07.726747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:07.853009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ee9f5-1831-4ddd-be7d-9ced306d6074 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:07.937636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:07.963971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfa95f-7340-4c41-9fb6-2df2c99a9799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:07.964505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa95f-7340-4c41-9fb6-2df2c99a9799 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:07.964797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa95f-7340-4c41-9fb6-2df2c99a9799 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:07.965092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa95f-7340-4c41-9fb6-2df2c99a9799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:07.966662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9bdfa95f-7340-4c41-9fb6-2df2c99a9799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:08.053855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa95f-7340-4c41-9fb6-2df2c99a9799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:08.055437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa95f-7340-4c41-9fb6-2df2c99a9799 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:08.073253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 562/1111] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:09.116408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0aacf-6055-4fe6-922c-12293d473738 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:09.116989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0aacf-6055-4fe6-922c-12293d473738 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:09.116989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0aacf-6055-4fe6-922c-12293d473738 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:09.118331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 550/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:09.123276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9081ba-cec1-486b-a10e-fa81984c1621 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:09.123692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9081ba-cec1-486b-a10e-fa81984c1621 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:09.123814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9081ba-cec1-486b-a10e-fa81984c1621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:09.197597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2f9081ba-cec1-486b-a10e-fa81984c1621 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:09.198774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2f9081ba-cec1-486b-a10e-fa81984c1621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:09.239395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:09.293605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 563/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:09.443979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0aacf-6055-4fe6-922c-12293d473738 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:09.445538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1fa0aacf-6055-4fe6-922c-12293d473738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:09.589143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0aacf-6055-4fe6-922c-12293d473738 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:09.642183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:09.702001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc7b1e-e6e3-4f1c-8e10-fa7da29ee5f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:09.702523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc7b1e-e6e3-4f1c-8e10-fa7da29ee5f1 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:09.702793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc7b1e-e6e3-4f1c-8e10-fa7da29ee5f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:09.703055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc7b1e-e6e3-4f1c-8e10-fa7da29ee5f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:09.704617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-75cc7b1e-e6e3-4f1c-8e10-fa7da29ee5f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:09.793566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc7b1e-e6e3-4f1c-8e10-fa7da29ee5f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:09.795130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc7b1e-e6e3-4f1c-8e10-fa7da29ee5f1 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:09.812828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 551/1114] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:10.854954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa23c6-a163-4853-9fe5-2ebc6f4d649a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:10.855509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa23c6-a163-4853-9fe5-2ebc6f4d649a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:10.855509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa23c6-a163-4853-9fe5-2ebc6f4d649a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:10.856825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 564/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:10.861631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebbd10-fd8b-4d09-a29c-72bd1236ba5f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:10.862077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebbd10-fd8b-4d09-a29c-72bd1236ba5f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:10.862175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebbd10-fd8b-4d09-a29c-72bd1236ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:10.937562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-deebbd10-fd8b-4d09-a29c-72bd1236ba5f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:10.938775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-deebbd10-fd8b-4d09-a29c-72bd1236ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:10.940797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:11.034988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 552/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:11.184546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa23c6-a163-4853-9fe5-2ebc6f4d649a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:11.186092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-93aa23c6-a163-4853-9fe5-2ebc6f4d649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:11.329666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa23c6-a163-4853-9fe5-2ebc6f4d649a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:11.357220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:11.442192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b8929-b7b5-4463-905d-aa44e512c7d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:11.442804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b8929-b7b5-4463-905d-aa44e512c7d9 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:11.443082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b8929-b7b5-4463-905d-aa44e512c7d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:11.443354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b8929-b7b5-4463-905d-aa44e512c7d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:11.445002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-030b8929-b7b5-4463-905d-aa44e512c7d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:11.532896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b8929-b7b5-4463-905d-aa44e512c7d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:11.534577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b8929-b7b5-4463-905d-aa44e512c7d9 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:11.552489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 565/1117] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:13.588102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e791f6-809a-447c-bfe4-721533b6b82e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:13.588669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e791f6-809a-447c-bfe4-721533b6b82e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:13.588669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e791f6-809a-447c-bfe4-721533b6b82e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:13.590071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 553/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:13.595279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bafde5-e9c9-4d0e-ac94-50aeed9b7594 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:13.595724 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bafde5-e9c9-4d0e-ac94-50aeed9b7594 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:13.595838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bafde5-e9c9-4d0e-ac94-50aeed9b7594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:13.635660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:13.660811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d6bafde5-e9c9-4d0e-ac94-50aeed9b7594 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:13.662066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d6bafde5-e9c9-4d0e-ac94-50aeed9b7594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:13.757229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 566/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:14.037650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e791f6-809a-447c-bfe4-721533b6b82e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:14.039181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-51e791f6-809a-447c-bfe4-721533b6b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:14.145148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e791f6-809a-447c-bfe4-721533b6b82e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:14.177465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:14.218991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6964-7461-4a05-a961-4120cb7e9dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:14.219590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6964-7461-4a05-a961-4120cb7e9dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:14.219864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6964-7461-4a05-a961-4120cb7e9dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:14.220129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6964-7461-4a05-a961-4120cb7e9dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:14.221727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3b5e6964-7461-4a05-a961-4120cb7e9dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:14.328413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6964-7461-4a05-a961-4120cb7e9dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:14.329793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6964-7461-4a05-a961-4120cb7e9dd7 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:14.347803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 554/1120] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:16.694425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cbb8-cafe-4dff-8e0d-f14663b0d263 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:16.694997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cbb8-cafe-4dff-8e0d-f14663b0d263 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:16.694997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cbb8-cafe-4dff-8e0d-f14663b0d263 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:16.696327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 567/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:16.701608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b613ba-6619-452d-856b-630895a14ed7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:16.702009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b613ba-6619-452d-856b-630895a14ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:16.702150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b613ba-6619-452d-856b-630895a14ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:16.767470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d4b613ba-6619-452d-856b-630895a14ed7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:16.768651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d4b613ba-6619-452d-856b-630895a14ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:16.781751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:16.865170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 555/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:17.149493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58cbb8-cafe-4dff-8e0d-f14663b0d263 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:17.151019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb58cbb8-cafe-4dff-8e0d-f14663b0d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:17.252379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58cbb8-cafe-4dff-8e0d-f14663b0d263 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:17.264883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:17.325601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f6126-f4be-40c0-bb2f-bc7959eb6269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:17.326200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6126-f4be-40c0-bb2f-bc7959eb6269 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:17.326477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6126-f4be-40c0-bb2f-bc7959eb6269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:17.326746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f6126-f4be-40c0-bb2f-bc7959eb6269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:17.328314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-951f6126-f4be-40c0-bb2f-bc7959eb6269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:17.436793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f6126-f4be-40c0-bb2f-bc7959eb6269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:17.438253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f6126-f4be-40c0-bb2f-bc7959eb6269 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:17.456137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 568/1123] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:19.886934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77870d65-cfbf-419f-9e77-cc8aced8b61d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:19.887477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77870d65-cfbf-419f-9e77-cc8aced8b61d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:19.887477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77870d65-cfbf-419f-9e77-cc8aced8b61d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:19.889137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 556/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:19.894355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803c29-c33e-4a19-beb4-6a89e26ebe96 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:19.894768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803c29-c33e-4a19-beb4-6a89e26ebe96 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:19.894910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803c29-c33e-4a19-beb4-6a89e26ebe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:19.942172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:19.960979 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-27803c29-c33e-4a19-beb4-6a89e26ebe96 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:19.962455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-27803c29-c33e-4a19-beb4-6a89e26ebe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:20.055273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 569/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:20.342306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77870d65-cfbf-419f-9e77-cc8aced8b61d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:20.343874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77870d65-cfbf-419f-9e77-cc8aced8b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:20.447242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77870d65-cfbf-419f-9e77-cc8aced8b61d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:20.488046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:20.521951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41c6e0-9352-4091-91b3-381d4bd25436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:20.522543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c6e0-9352-4091-91b3-381d4bd25436 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:20.522814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c6e0-9352-4091-91b3-381d4bd25436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:20.523076 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c6e0-9352-4091-91b3-381d4bd25436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:20.524639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb41c6e0-9352-4091-91b3-381d4bd25436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:20.630881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41c6e0-9352-4091-91b3-381d4bd25436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:20.632265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41c6e0-9352-4091-91b3-381d4bd25436 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:20.649758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 557/1126] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:22.907215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f629bd-6380-47d5-bb9c-3e8a4be7d852 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:22.907807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f629bd-6380-47d5-bb9c-3e8a4be7d852 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:22.907807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f629bd-6380-47d5-bb9c-3e8a4be7d852 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:22.909163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 570/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:22.915009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993184ac-56b3-4c24-8940-15b7dcdcaccb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:22.915451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993184ac-56b3-4c24-8940-15b7dcdcaccb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:22.915588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993184ac-56b3-4c24-8940-15b7dcdcaccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:22.980633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-993184ac-56b3-4c24-8940-15b7dcdcaccb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:22.981847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-993184ac-56b3-4c24-8940-15b7dcdcaccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:23.002470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:23.078795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 558/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:23.364213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f629bd-6380-47d5-bb9c-3e8a4be7d852 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:23.365775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-60f629bd-6380-47d5-bb9c-3e8a4be7d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:23.467886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f629bd-6380-47d5-bb9c-3e8a4be7d852 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:23.488436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:23.541543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab7bdd-e522-484b-8230-1368d5cad9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:23.542151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab7bdd-e522-484b-8230-1368d5cad9dd service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:23.542432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab7bdd-e522-484b-8230-1368d5cad9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:23.542705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab7bdd-e522-484b-8230-1368d5cad9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:23.544300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0dab7bdd-e522-484b-8230-1368d5cad9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:23.653526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab7bdd-e522-484b-8230-1368d5cad9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:23.654875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab7bdd-e522-484b-8230-1368d5cad9dd service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:23.673096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 571/1129] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:25.859290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fd02-9fa1-4271-9d96-c9cc1b5070a9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:25.859895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fd02-9fa1-4271-9d96-c9cc1b5070a9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:25.859895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fd02-9fa1-4271-9d96-c9cc1b5070a9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:25.861226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 559/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:25.866935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0afe-e35f-4f97-a61d-3965b999eaf1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:25.867356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0afe-e35f-4f97-a61d-3965b999eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:25.867468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0afe-e35f-4f97-a61d-3965b999eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:25.932375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:25.935039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-73df0afe-e35f-4f97-a61d-3965b999eaf1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:25.936685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73df0afe-e35f-4f97-a61d-3965b999eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:26.031154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 572/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:26.315085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910fd02-9fa1-4271-9d96-c9cc1b5070a9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:26.316631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2910fd02-9fa1-4271-9d96-c9cc1b5070a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:26.418629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910fd02-9fa1-4271-9d96-c9cc1b5070a9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:26.466886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:26.491785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93237420-9521-4e8a-90c7-361a9de7c4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:26.492392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237420-9521-4e8a-90c7-361a9de7c4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:26.492663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237420-9521-4e8a-90c7-361a9de7c4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:26.492925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237420-9521-4e8a-90c7-361a9de7c4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:26.494518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-93237420-9521-4e8a-90c7-361a9de7c4f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:26.603769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93237420-9521-4e8a-90c7-361a9de7c4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:26.605247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93237420-9521-4e8a-90c7-361a9de7c4f8 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:26.622868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 560/1132] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:28.835833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4633e0-546b-4beb-bdce-bc03b9969279 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:28.836401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4633e0-546b-4beb-bdce-bc03b9969279 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:28.836401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4633e0-546b-4beb-bdce-bc03b9969279 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:28.837972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 573/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:28.843368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d106-917f-4494-85cf-2f1f5bfa3177 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:28.843777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d106-917f-4494-85cf-2f1f5bfa3177 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:28.843907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d106-917f-4494-85cf-2f1f5bfa3177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:28.909444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1510d106-917f-4494-85cf-2f1f5bfa3177 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:28.910637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1510d106-917f-4494-85cf-2f1f5bfa3177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:28.940393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:29.008387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 561/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:29.290146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4633e0-546b-4beb-bdce-bc03b9969279 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:29.291729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fd4633e0-546b-4beb-bdce-bc03b9969279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:29.394029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4633e0-546b-4beb-bdce-bc03b9969279 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:29.421227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:29.466456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ce69d-5059-4131-9e3f-a785a492a71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:29.467056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ce69d-5059-4131-9e3f-a785a492a71b service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:29.467331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ce69d-5059-4131-9e3f-a785a492a71b service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:29.467596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ce69d-5059-4131-9e3f-a785a492a71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:29.469224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ee8ce69d-5059-4131-9e3f-a785a492a71b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:29.575144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ce69d-5059-4131-9e3f-a785a492a71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:29.576565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ce69d-5059-4131-9e3f-a785a492a71b service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:29.595972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 574/1135] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:31.788242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca146f-5cd7-45ec-b58e-11c205f31760 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:31.788781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca146f-5cd7-45ec-b58e-11c205f31760 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:31.788781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca146f-5cd7-45ec-b58e-11c205f31760 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:31.790163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 562/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:31.795583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d55d8-5f91-4428-adec-f5b8ac45e307 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:31.796021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d55d8-5f91-4428-adec-f5b8ac45e307 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:31.796128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d55d8-5f91-4428-adec-f5b8ac45e307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:31.861436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7c6d55d8-5f91-4428-adec-f5b8ac45e307 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:31.862623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c6d55d8-5f91-4428-adec-f5b8ac45e307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:31.871271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:31.958602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 575/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:32.239798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca146f-5cd7-45ec-b58e-11c205f31760 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:32.241954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3cca146f-5cd7-45ec-b58e-11c205f31760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:32.348221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca146f-5cd7-45ec-b58e-11c205f31760 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:32.404053 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:32.422808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4b358-26e3-4c62-9558-a114dcefe412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:32.423412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b358-26e3-4c62-9558-a114dcefe412 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:32.423689 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b358-26e3-4c62-9558-a114dcefe412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:32.423957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b358-26e3-4c62-9558-a114dcefe412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:32.425565 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a5e4b358-26e3-4c62-9558-a114dcefe412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:32.534371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4b358-26e3-4c62-9558-a114dcefe412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:32.535804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4b358-26e3-4c62-9558-a114dcefe412 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:32.553904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 563/1138] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:34.738802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de755f57-9d2d-41ca-bb9f-65f3d6c37f31 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:34.739398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de755f57-9d2d-41ca-bb9f-65f3d6c37f31 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:34.739398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de755f57-9d2d-41ca-bb9f-65f3d6c37f31 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:34.741139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 576/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:34.746472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a15cc-ad6b-469d-8017-828bc9b2b8a8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:34.746912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a15cc-ad6b-469d-8017-828bc9b2b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:34.747021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a15cc-ad6b-469d-8017-828bc9b2b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:34.813178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2c1a15cc-ad6b-469d-8017-828bc9b2b8a8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:34.814380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2c1a15cc-ad6b-469d-8017-828bc9b2b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:34.853411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:34.910076 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 564/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:35.195231 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de755f57-9d2d-41ca-bb9f-65f3d6c37f31 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:35.196808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-de755f57-9d2d-41ca-bb9f-65f3d6c37f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:35.297817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de755f57-9d2d-41ca-bb9f-65f3d6c37f31 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:35.334969 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:35.371206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c2d34-c365-4668-9688-b083f232a4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:35.371750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2d34-c365-4668-9688-b083f232a4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:35.372024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2d34-c365-4668-9688-b083f232a4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:35.372293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2d34-c365-4668-9688-b083f232a4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:35.373969 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b9c2d34-c365-4668-9688-b083f232a4e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:35.479911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c2d34-c365-4668-9688-b083f232a4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:35.481374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c2d34-c365-4668-9688-b083f232a4e2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:35.499510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 577/1141] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:37.643020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52019c-137e-4761-b902-231f851ddfb3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:37.643586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52019c-137e-4761-b902-231f851ddfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:37.643586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52019c-137e-4761-b902-231f851ddfb3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:37.644901 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 565/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:37.650397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b406b-f6e0-4da8-b508-761e8261b398 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:37.650822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b406b-f6e0-4da8-b508-761e8261b398 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:37.650956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b406b-f6e0-4da8-b508-761e8261b398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:37.716540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b76b406b-f6e0-4da8-b508-761e8261b398 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:37.717764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b76b406b-f6e0-4da8-b508-761e8261b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:37.735435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:37.814300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 578/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:05:38.094010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52019c-137e-4761-b902-231f851ddfb3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:38.095530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fc52019c-137e-4761-b902-231f851ddfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:38.197887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52019c-137e-4761-b902-231f851ddfb3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:38.264760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:38.272476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4171-268b-435b-97f9-443f2afefb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:38.273101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4171-268b-435b-97f9-443f2afefb6d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:38.273374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4171-268b-435b-97f9-443f2afefb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:38.273711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4171-268b-435b-97f9-443f2afefb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:38.275276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-139d4171-268b-435b-97f9-443f2afefb6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:38.383067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4171-268b-435b-97f9-443f2afefb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:38.384402 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4171-268b-435b-97f9-443f2afefb6d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:38.401759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 566/1144] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:40.583647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8cc2-762e-4bb6-b2a6-87115e512189 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:40.584734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8cc2-762e-4bb6-b2a6-87115e512189 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:40.584734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8cc2-762e-4bb6-b2a6-87115e512189 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:40.586105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 579/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:05:40.591811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17203db-7092-42d7-91bb-97614bf01ee8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:40.592242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17203db-7092-42d7-91bb-97614bf01ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:40.592356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17203db-7092-42d7-91bb-97614bf01ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:40.658336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a17203db-7092-42d7-91bb-97614bf01ee8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:05:40.659545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a17203db-7092-42d7-91bb-97614bf01ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:40.707709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:40.758968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 567/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:05:41.046805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8cc2-762e-4bb6-b2a6-87115e512189 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:41.048344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e56c8cc2-762e-4bb6-b2a6-87115e512189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:41.152729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8cc2-762e-4bb6-b2a6-87115e512189 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:41.199614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:41.226474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2228a-0874-40b2-b296-387f9ffb3cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:41.227081 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2228a-0874-40b2-b296-387f9ffb3cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:41.227359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2228a-0874-40b2-b296-387f9ffb3cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:41.227630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2228a-0874-40b2-b296-387f9ffb3cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:41.229237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-14a2228a-0874-40b2-b296-387f9ffb3cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:41.336145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2228a-0874-40b2-b296-387f9ffb3cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:41.337533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2228a-0874-40b2-b296-387f9ffb3cf5 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:41.355802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 580/1147] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:50.757456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=22 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:51.353467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=66 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:01.082033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1a6ac-19d4-45c3-ab2b-c4ca0070e0d2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:01.082613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1a6ac-19d4-45c3-ab2b-c4ca0070e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:01.082613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1a6ac-19d4-45c3-ab2b-c4ca0070e0d2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:01.083909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 568/1148] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:01.089776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e18e8-964d-4b9b-b2c6-2fee33084f19 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:01.090416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e18e8-964d-4b9b-b2c6-2fee33084f19 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:01.090585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e18e8-964d-4b9b-b2c6-2fee33084f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:01.157197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3a7e18e8-964d-4b9b-b2c6-2fee33084f19 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:01.158399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3a7e18e8-964d-4b9b-b2c6-2fee33084f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:01.254002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 581/1149] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:01.551599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e90a-f12c-4dea-95e0-4d5b4035597a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:01.551881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e90a-f12c-4dea-95e0-4d5b4035597a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:01.552157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e90a-f12c-4dea-95e0-4d5b4035597a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:01.553550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 569/1150] 10.222.0.25 () {54 vars in 962 bytes} [Sun Oct 23 02:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:01.559242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911a0f8-5182-425d-a10c-d0f283066680 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:01.559612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911a0f8-5182-425d-a10c-d0f283066680 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:01.559954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911a0f8-5182-425d-a10c-d0f283066680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:01.634811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e911a0f8-5182-425d-a10c-d0f283066680 None None] MFA Rules not processed for user `a17dda73b3ad4896a282dbd1b4cc8bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:01.635937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e911a0f8-5182-425d-a10c-d0f283066680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:01.658249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:01.712607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 582/1151] 10.222.0.25 () {58 vars in 1059 bytes} [Sun Oct 23 02:06:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:01.720894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2e90a-f12c-4dea-95e0-4d5b4035597a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:01.722413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a8d2e90a-f12c-4dea-95e0-4d5b4035597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:01.822742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2e90a-f12c-4dea-95e0-4d5b4035597a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:01.897333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cec3aa-2681-4ab2-ace6-44d22e95cc51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:01.897861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cec3aa-2681-4ab2-ace6-44d22e95cc51 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:01.898135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cec3aa-2681-4ab2-ace6-44d22e95cc51 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:01.898404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cec3aa-2681-4ab2-ace6-44d22e95cc51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:01.899991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-16cec3aa-2681-4ab2-ace6-44d22e95cc51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:01.957300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:02.012355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cec3aa-2681-4ab2-ace6-44d22e95cc51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:02.013805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cec3aa-2681-4ab2-ace6-44d22e95cc51 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:02.031621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 570/1152] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:04.242545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09a61-4fff-4575-b6ae-cf1679ac70ae None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:04.243097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09a61-4fff-4575-b6ae-cf1679ac70ae None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:04.243097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09a61-4fff-4575-b6ae-cf1679ac70ae None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:04.244441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 583/1153] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:04.249742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba22847-2786-42ee-957f-5e372504fd9c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:04.250185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba22847-2786-42ee-957f-5e372504fd9c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:04.250282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba22847-2786-42ee-957f-5e372504fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:04.315587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3ba22847-2786-42ee-957f-5e372504fd9c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:04.316764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3ba22847-2786-42ee-957f-5e372504fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:04.410932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 571/1154] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:04.681079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09a61-4fff-4575-b6ae-cf1679ac70ae None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:04.682517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-57e09a61-4fff-4575-b6ae-cf1679ac70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:04.806556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09a61-4fff-4575-b6ae-cf1679ac70ae None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:04.855598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:04.900284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b223641-6047-4dee-9727-b54dd7c1f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:04.900888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b223641-6047-4dee-9727-b54dd7c1f1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:04.901196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b223641-6047-4dee-9727-b54dd7c1f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:04.901467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b223641-6047-4dee-9727-b54dd7c1f1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:04.902098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b223641-6047-4dee-9727-b54dd7c1f1f1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:04.903113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-4b223641-6047-4dee-9727-b54dd7c1f1f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:06:04.903113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 02:06:04.903113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 02:06:04.904244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b223641-6047-4dee-9727-b54dd7c1f1f1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:04.924331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 584/1155] 10.222.0.25 () {56 vars in 1108 bytes} [Sun Oct 23 02:06:04 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:06:07.066153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac591cb-e250-40dc-be19-a268bd721e83 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:07.066715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac591cb-e250-40dc-be19-a268bd721e83 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:07.066715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac591cb-e250-40dc-be19-a268bd721e83 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:07.068069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 572/1156] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:07.073388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7e0a5-5e30-42b7-8812-140a7cbde606 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:07.073783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7e0a5-5e30-42b7-8812-140a7cbde606 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:07.073927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7e0a5-5e30-42b7-8812-140a7cbde606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:07.139495 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-20e7e0a5-5e30-42b7-8812-140a7cbde606 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:07.140686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20e7e0a5-5e30-42b7-8812-140a7cbde606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:07.235044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 585/1157] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:07.530290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac591cb-e250-40dc-be19-a268bd721e83 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:07.531937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eac591cb-e250-40dc-be19-a268bd721e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:07.542214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:07.678043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac591cb-e250-40dc-be19-a268bd721e83 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:07.756685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:07.790631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c03d7-0fce-47b6-9fcb-8e48572fadc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:07.791227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c03d7-0fce-47b6-9fcb-8e48572fadc6 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:07.791501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c03d7-0fce-47b6-9fcb-8e48572fadc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:07.791766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c03d7-0fce-47b6-9fcb-8e48572fadc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:07.793360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2c2c03d7-0fce-47b6-9fcb-8e48572fadc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:07.880745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c03d7-0fce-47b6-9fcb-8e48572fadc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:07.882341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c03d7-0fce-47b6-9fcb-8e48572fadc6 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:07.900309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 573/1158] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:10.206268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c20ba7-b2a7-4fb4-b2d8-aed204575e26 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:10.206861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c20ba7-b2a7-4fb4-b2d8-aed204575e26 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:10.206861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c20ba7-b2a7-4fb4-b2d8-aed204575e26 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:10.208165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 586/1159] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:10.213468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2eec-bdd7-4bb1-929b-3736239fa9bd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:10.213909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2eec-bdd7-4bb1-929b-3736239fa9bd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:10.214041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2eec-bdd7-4bb1-929b-3736239fa9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:10.279186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-01ff2eec-bdd7-4bb1-929b-3736239fa9bd None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:10.280386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-01ff2eec-bdd7-4bb1-929b-3736239fa9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:10.326554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:10.377751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 574/1160] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:10.660367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c20ba7-b2a7-4fb4-b2d8-aed204575e26 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:10.661990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-94c20ba7-b2a7-4fb4-b2d8-aed204575e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:10.686025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:10.766628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c20ba7-b2a7-4fb4-b2d8-aed204575e26 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:10.838938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e1d29-c3b7-48ae-a027-1af88c8fc229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:10.839536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e1d29-c3b7-48ae-a027-1af88c8fc229 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:10.839807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e1d29-c3b7-48ae-a027-1af88c8fc229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:10.840072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e1d29-c3b7-48ae-a027-1af88c8fc229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:10.841917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2d9e1d29-c3b7-48ae-a027-1af88c8fc229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:10.913308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:10.948761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e1d29-c3b7-48ae-a027-1af88c8fc229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:10.950272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e1d29-c3b7-48ae-a027-1af88c8fc229 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:10.970506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 587/1161] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:13.146832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688b08d-e9a1-462e-9419-9f3544e238da None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:13.147322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688b08d-e9a1-462e-9419-9f3544e238da None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:13.147435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688b08d-e9a1-462e-9419-9f3544e238da None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:13.149277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 575/1162] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:13.154391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffbc6-47e7-4523-8590-3ec660a201bd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:13.154773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffbc6-47e7-4523-8590-3ec660a201bd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:13.154935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffbc6-47e7-4523-8590-3ec660a201bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:13.220674 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ed0ffbc6-47e7-4523-8590-3ec660a201bd None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:13.221904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed0ffbc6-47e7-4523-8590-3ec660a201bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:13.315513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 588/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:13.606245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688b08d-e9a1-462e-9419-9f3544e238da None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:13.607830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a688b08d-e9a1-462e-9419-9f3544e238da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:13.708551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688b08d-e9a1-462e-9419-9f3544e238da None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:13.781427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:13.782916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463fa09-7579-4399-8818-17e74c15136b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:13.783523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463fa09-7579-4399-8818-17e74c15136b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:13.783988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463fa09-7579-4399-8818-17e74c15136b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:13.784427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463fa09-7579-4399-8818-17e74c15136b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:13.786221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2463fa09-7579-4399-8818-17e74c15136b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:13.894194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463fa09-7579-4399-8818-17e74c15136b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:13.895617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463fa09-7579-4399-8818-17e74c15136b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:13.913935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 576/1164] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:16.210604 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960376a-b4f9-48bc-9b3f-89897c33ae61 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:16.211189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960376a-b4f9-48bc-9b3f-89897c33ae61 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:16.211189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960376a-b4f9-48bc-9b3f-89897c33ae61 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:16.212513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 589/1165] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 02:06:16.217984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a2418-c4ed-4072-82d5-a191cd164c83 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:16.218422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a2418-c4ed-4072-82d5-a191cd164c83 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:16.218529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a2418-c4ed-4072-82d5-a191cd164c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:16.282729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-784a2418-c4ed-4072-82d5-a191cd164c83 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:16.283906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-784a2418-c4ed-4072-82d5-a191cd164c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:16.335402 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:16.379050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 577/1166] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:16.668892 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960376a-b4f9-48bc-9b3f-89897c33ae61 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:16.670473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d960376a-b4f9-48bc-9b3f-89897c33ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:16.706315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:16.773944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960376a-b4f9-48bc-9b3f-89897c33ae61 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:16.846421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1742db9-f0fd-4d30-9594-01eea21efab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:16.847024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742db9-f0fd-4d30-9594-01eea21efab2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:16.847301 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742db9-f0fd-4d30-9594-01eea21efab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:16.847576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742db9-f0fd-4d30-9594-01eea21efab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:16.849180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a1742db9-f0fd-4d30-9594-01eea21efab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:16.928374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:16.960875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1742db9-f0fd-4d30-9594-01eea21efab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:16.962407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1742db9-f0fd-4d30-9594-01eea21efab2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:16.980952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 590/1167] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:19.322048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88907-5abd-45cb-be04-18c06189bce0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:19.322620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88907-5abd-45cb-be04-18c06189bce0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:19.322620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88907-5abd-45cb-be04-18c06189bce0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:19.323923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 578/1168] 10.222.0.25 () {54 vars in 927 bytes} [Sun Oct 23 02:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:19.329440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95f55-f303-4bfe-9926-b46d1f3d5a58 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:19.329877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95f55-f303-4bfe-9926-b46d1f3d5a58 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:19.329987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95f55-f303-4bfe-9926-b46d1f3d5a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:19.396426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e7d95f55-f303-4bfe-9926-b46d1f3d5a58 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:19.397659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7d95f55-f303-4bfe-9926-b46d1f3d5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:19.493565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 591/1169] 10.222.0.25 () {58 vars in 1024 bytes} [Sun Oct 23 02:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:19.780331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f88907-5abd-45cb-be04-18c06189bce0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:19.781925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-53f88907-5abd-45cb-be04-18c06189bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:19.884923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f88907-5abd-45cb-be04-18c06189bce0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:19.956773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57daf-d7e6-4bf9-b67c-d7341110e2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:19.957399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57daf-d7e6-4bf9-b67c-d7341110e2bb service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:19.957677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57daf-d7e6-4bf9-b67c-d7341110e2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:19.957954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57daf-d7e6-4bf9-b67c-d7341110e2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:19.959524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-19c57daf-d7e6-4bf9-b67c-d7341110e2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:19.968800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:20.068276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c57daf-d7e6-4bf9-b67c-d7341110e2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:20.069652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c57daf-d7e6-4bf9-b67c-d7341110e2bb service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:20.087027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 579/1170] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:29.491997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=82 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:30.084822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=50 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:39.290347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:39.290928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:39.290928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:39.366051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:39.367240 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:39.460671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 592/1171] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:39.468741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1a41-6b05-441f-9d97-b64b62088945 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:39.469263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1a41-6b05-441f-9d97-b64b62088945 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:39.469368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1a41-6b05-441f-9d97-b64b62088945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:39.544015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-aadc1a41-6b05-441f-9d97-b64b62088945 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:39.545236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aadc1a41-6b05-441f-9d97-b64b62088945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:39.639912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 580/1172] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:39.644597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:39.645852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:39.657730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d5d20-04ba-4362-b102-dfce92c8244e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:39.718690 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:39.751838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:39.752441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:39.752717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:39.752998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:39.753648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:07:39.753947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:39.754952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:07:39.754952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 02:07:39.754952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 02:07:39.755826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:39.767694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 593/1173] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:07:39.777703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc1a41-6b05-441f-9d97-b64b62088945 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:39.786767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc1a41-6b05-441f-9d97-b64b62088945 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:39.848199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:39.882274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:39.882870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:39.883140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:39.883405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:39.884024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:39.885208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:07:39.885208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 02:07:39.885208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 02:07:39.886975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:39.942109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 581/1174] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:07:39 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:07:39.946232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:39.947728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:39.981704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794797c-fc99-4366-9672-7ed372a698a0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:40.072981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:40.073616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:40.073891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:40.074156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:40.074783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:40.075777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:07:40.075777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 02:07:40.075777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 02:07:40.076964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:40.118887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 594/1175] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:07:39 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:07:40.123219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:40.124736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:40.185776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f23f8-3a31-42c8-a193-8bd71ffd190c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:40.270330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:40.282562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:40.283186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:40.283459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:40.283723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:40.284347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:40.285945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:40.297915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 582/1176] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:07:40.302009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:40.303529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:40.314654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14329-e7d9-4e50-ac13-ff3b1eb98e19 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:40.340066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:40.409156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac916-98b1-435e-b6f3-501b706bc5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:40.409767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac916-98b1-435e-b6f3-501b706bc5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:40.410045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac916-98b1-435e-b6f3-501b706bc5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:40.410311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac916-98b1-435e-b6f3-501b706bc5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:40.410949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac916-98b1-435e-b6f3-501b706bc5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:40.412544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac916-98b1-435e-b6f3-501b706bc5ca admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:40.425139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 595/1177] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:07:40.429312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:40.430807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:40.464215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e43b3-12ef-449c-b91b-6535ccbc4f19 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:40.557357 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f0834-34ec-447f-9f5c-3060a473d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:40.558542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f0834-34ec-447f-9f5c-3060a473d45e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:40.558773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f0834-34ec-447f-9f5c-3060a473d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:40.559042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f0834-34ec-447f-9f5c-3060a473d45e admin admin] PATH_INFO: `/v3/projects/09ad0c4bd52148ceb763ac71b14f49d7/users/3710c1904ffc40a2bbe4e6ba98f06bfd/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:40.580959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f0834-34ec-447f-9f5c-3060a473d45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ad0c4bd52148ceb763ac71b14f49d7, user_id=3710c1904ffc40a2bbe4e6ba98f06bfd, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:40.583600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f0834-34ec-447f-9f5c-3060a473d45e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:40.609521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 583/1178] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:07:40 2022] PUT /identity/v3/projects/09ad0c4bd52148ceb763ac71b14f49d7/users/3710c1904ffc40a2bbe4e6ba98f06bfd/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:07:40.620619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aeb7-38ac-4cf5-a97d-8f91e7d5e028 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:40.620904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aeb7-38ac-4cf5-a97d-8f91e7d5e028 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:40.621223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aeb7-38ac-4cf5-a97d-8f91e7d5e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:40.676943 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-62d7aeb7-38ac-4cf5-a97d-8f91e7d5e028 None None] MFA Rules not processed for user `3710c1904ffc40a2bbe4e6ba98f06bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:40.678151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-62d7aeb7-38ac-4cf5-a97d-8f91e7d5e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:40.754080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 596/1179] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:07:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:40.767924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01038a-3f15-400b-a2c8-1af61f9257dd None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:40.768214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01038a-3f15-400b-a2c8-1af61f9257dd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:40.768485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01038a-3f15-400b-a2c8-1af61f9257dd None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:40.769840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 584/1180] 10.222.0.25 () {54 vars in 963 bytes} [Sun Oct 23 02:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:07:40.774583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ec70-f294-4a23-8d9a-21ecf55fd3f3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:40.774908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ec70-f294-4a23-8d9a-21ecf55fd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:40.775189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ec70-f294-4a23-8d9a-21ecf55fd3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:40.807309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:40.851897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b2a7ec70-f294-4a23-8d9a-21ecf55fd3f3 None None] MFA Rules not processed for user `f681d888b56c4fea8acd271e1d51ae3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:40.853057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2a7ec70-f294-4a23-8d9a-21ecf55fd3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:40.927524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 597/1181] 10.222.0.25 () {58 vars in 1060 bytes} [Sun Oct 23 02:07:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:40.935133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01038a-3f15-400b-a2c8-1af61f9257dd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:40.936644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ad01038a-3f15-400b-a2c8-1af61f9257dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:40.985920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:41.039240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01038a-3f15-400b-a2c8-1af61f9257dd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:41.112546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:41.113113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:41.113396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:41.113669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:41.115270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:41.213396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:41.215403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:41.218843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:41.233804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 585/1182] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:07:41.279021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681e359-2ab9-44fc-9614-e1d7144695b1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:41.279309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681e359-2ab9-44fc-9614-e1d7144695b1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:41.279588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681e359-2ab9-44fc-9614-e1d7144695b1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:41.280843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 598/1183] 10.222.0.25 () {52 vars in 830 bytes} [Sun Oct 23 02:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:07:41.284282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:41.285551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:41.383769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b644-3279-4d71-b530-7f8bd13ea9ac service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:41.476218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:41.476839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:41.477151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:41.477418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] PATH_INFO: `/v3/users/3710c1904ffc40a2bbe4e6ba98f06bfd` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:41.491270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3710c1904ffc40a2bbe4e6ba98f06bfd)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:41.492324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:07:41.492324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 02:07:41.492324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 02:07:41.493564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:41.503765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:41.561524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3710c1904ffc40a2bbe4e6ba98f06bfd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:41.562456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3710c1904ffc40a2bbe4e6ba98f06bfd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:41.570546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3710c1904ffc40a2bbe4e6ba98f06bfd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:41.571075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3710c1904ffc40a2bbe4e6ba98f06bfd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:41.595241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3710c1904ffc40a2bbe4e6ba98f06bfd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:41.614294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 586/1184] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:07:41 2022] DELETE /identity/v3/users/3710c1904ffc40a2bbe4e6ba98f06bfd => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:07:41.618848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:41.619325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:41.619406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:41.677553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:41.678894 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:41.761781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:41.778064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 599/1185] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:41.787766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:41.789146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:41.891593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b19d64-4a24-4012-b69c-1b9db852a38b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:41.946710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:41.967527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e37636-378d-4407-8ed0-a315a7ffe59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:41.968146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37636-378d-4407-8ed0-a315a7ffe59e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:41.968420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37636-378d-4407-8ed0-a315a7ffe59e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:41.968690 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37636-378d-4407-8ed0-a315a7ffe59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:41.970332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-27e37636-378d-4407-8ed0-a315a7ffe59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:42.083992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e37636-378d-4407-8ed0-a315a7ffe59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:42.085482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e37636-378d-4407-8ed0-a315a7ffe59e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:42.105899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 587/1186] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:07:42.426572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:42.427886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:42.440683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f092a-c2db-4a3e-b964-52985195a998 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:42.536791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:42.537468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:42.537747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:42.538017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] PATH_INFO: `/v3/projects/09ad0c4bd52148ceb763ac71b14f49d7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:42.548274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ad0c4bd52148ceb763ac71b14f49d7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:42.549336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:07:42.549336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 02:07:42.549336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 02:07:42.550527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:42.608488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ad0c4bd52148ceb763ac71b14f49d7', 'request_id': 'req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:42.618711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ad0c4bd52148ceb763ac71b14f49d7', 'request_id': 'req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:42.625464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ad0c4bd52148ceb763ac71b14f49d7', 'request_id': 'req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:42.654643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] The token cache is being invalidate because project 09ad0c4bd52148ceb763ac71b14f49d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:07:42.654933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:42.655362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee658536-2e0c-419d-8dd7-1c8bd5e78a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:07:42.656773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 600/1187] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:07:42 2022] DELETE /identity/v3/projects/09ad0c4bd52148ceb763ac71b14f49d7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:07:52.101905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=62 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:52.652599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:14.932347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebe30-aba7-4e5f-b11f-e8bff56baa86 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:14.932936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebe30-aba7-4e5f-b11f-e8bff56baa86 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:14.932936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebe30-aba7-4e5f-b11f-e8bff56baa86 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:14.934238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 588/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:14.939536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e71bd9-632c-4680-befc-4fed24bd782e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:14.940030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e71bd9-632c-4680-befc-4fed24bd782e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:14.940140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e71bd9-632c-4680-befc-4fed24bd782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:15.021191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-65e71bd9-632c-4680-befc-4fed24bd782e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:15.022387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65e71bd9-632c-4680-befc-4fed24bd782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:15.125075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 601/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:15.275279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebe30-aba7-4e5f-b11f-e8bff56baa86 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:15.277370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-309ebe30-aba7-4e5f-b11f-e8bff56baa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:15.392982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebe30-aba7-4e5f-b11f-e8bff56baa86 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:15.398365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b905db0-0b53-405a-ad97-c000bbaf2ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:15.398961 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b905db0-0b53-405a-ad97-c000bbaf2ae4 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:15.399236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b905db0-0b53-405a-ad97-c000bbaf2ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:15.399504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b905db0-0b53-405a-ad97-c000bbaf2ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:15.407999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b905db0-0b53-405a-ad97-c000bbaf2ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:15.409602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b905db0-0b53-405a-ad97-c000bbaf2ae4 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:15.418667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 589/1190] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:16.436609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e100-8b68-4930-b30c-6fead48f0fa4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:16.437245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e100-8b68-4930-b30c-6fead48f0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:16.437245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e100-8b68-4930-b30c-6fead48f0fa4 None None] PATH_INFO: `/v3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:16.438442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 602/1191] 10.222.0.43 () {54 vars in 925 bytes} [Sun Oct 23 02:09:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:09:16.446350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a2943-0626-4e16-8775-c9827c7943d4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:16.446774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a2943-0626-4e16-8775-c9827c7943d4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:16.446870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a2943-0626-4e16-8775-c9827c7943d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:16.485470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62bc0-5232-40d5-a2ac-8539821c204c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:16.485750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62bc0-5232-40d5-a2ac-8539821c204c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:16.486027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62bc0-5232-40d5-a2ac-8539821c204c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:16.487360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 603/1192] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 02:09:16.491996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ecbcc-39c1-4f8f-822f-1c3e1ea4ea66 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:16.492462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ecbcc-39c1-4f8f-822f-1c3e1ea4ea66 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:16.492902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ecbcc-39c1-4f8f-822f-1c3e1ea4ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:16.507070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a50a2943-0626-4e16-8775-c9827c7943d4 None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:16.508292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a50a2943-0626-4e16-8775-c9827c7943d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:16.512633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6d9ecbcc-39c1-4f8f-822f-1c3e1ea4ea66 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:16.513880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6d9ecbcc-39c1-4f8f-822f-1c3e1ea4ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:16.521777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 604/1193] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:09:16.577390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:16.583287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 590/1194] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Oct 23 02:09:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:16.672546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ecbcc-39c1-4f8f-822f-1c3e1ea4ea66 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:16.685213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ecbcc-39c1-4f8f-822f-1c3e1ea4ea66 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:16.690726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457935c-d2e6-4ee0-a9d4-b07fe0bfbd10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:16.691263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457935c-d2e6-4ee0-a9d4-b07fe0bfbd10 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:16.691540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457935c-d2e6-4ee0-a9d4-b07fe0bfbd10 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:16.691809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457935c-d2e6-4ee0-a9d4-b07fe0bfbd10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:16.699741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457935c-d2e6-4ee0-a9d4-b07fe0bfbd10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:16.701912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457935c-d2e6-4ee0-a9d4-b07fe0bfbd10 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:16.711032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 605/1195] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:25.112993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed4c65-f268-47f0-92f6-8ac66cd4c968 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:25.113538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed4c65-f268-47f0-92f6-8ac66cd4c968 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:25.113538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed4c65-f268-47f0-92f6-8ac66cd4c968 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:25.114884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 591/1196] 10.222.0.25 () {54 vars in 961 bytes} [Sun Oct 23 02:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:25.119783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee098fe6-0aa9-4598-9d58-626c1fb7b9c8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:25.120179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee098fe6-0aa9-4598-9d58-626c1fb7b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:25.120334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee098fe6-0aa9-4598-9d58-626c1fb7b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:25.140187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ee098fe6-0aa9-4598-9d58-626c1fb7b9c8 None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:25.141408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ee098fe6-0aa9-4598-9d58-626c1fb7b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:25.150297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 606/1197] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Oct 23 02:09:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:25.157714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed4c65-f268-47f0-92f6-8ac66cd4c968 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:25.171352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed4c65-f268-47f0-92f6-8ac66cd4c968 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:25.176235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45cc73-57b2-4178-b2f6-a1a33ca9f850 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:25.176820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45cc73-57b2-4178-b2f6-a1a33ca9f850 service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:25.177136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45cc73-57b2-4178-b2f6-a1a33ca9f850 service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:25.177408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45cc73-57b2-4178-b2f6-a1a33ca9f850 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:25.185916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45cc73-57b2-4178-b2f6-a1a33ca9f850 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:25.187501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45cc73-57b2-4178-b2f6-a1a33ca9f850 service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:25.196877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 592/1198] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:28.150134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779395d-79ea-4450-ad63-9c25e790c207 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:28.150598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779395d-79ea-4450-ad63-9c25e790c207 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:28.150706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779395d-79ea-4450-ad63-9c25e790c207 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:28.152113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 607/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:28.157061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698ed63-118c-41c2-b817-6fea3feec81c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:28.157494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698ed63-118c-41c2-b817-6fea3feec81c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:28.157619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698ed63-118c-41c2-b817-6fea3feec81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:28.177490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3698ed63-118c-41c2-b817-6fea3feec81c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:28.178693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3698ed63-118c-41c2-b817-6fea3feec81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:28.187078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 593/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:28.340918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779395d-79ea-4450-ad63-9c25e790c207 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:28.355255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779395d-79ea-4450-ad63-9c25e790c207 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:28.361064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca34f5-ef36-4439-99cf-2648e2d5a93c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:28.361655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca34f5-ef36-4439-99cf-2648e2d5a93c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:28.361928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca34f5-ef36-4439-99cf-2648e2d5a93c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:28.362195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca34f5-ef36-4439-99cf-2648e2d5a93c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:28.370369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca34f5-ef36-4439-99cf-2648e2d5a93c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:28.371908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca34f5-ef36-4439-99cf-2648e2d5a93c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:28.382152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 608/1201] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:29.435378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9f59-0751-4aec-90eb-a5a9e6ac784e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:29.435894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9f59-0751-4aec-90eb-a5a9e6ac784e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:29.436005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9f59-0751-4aec-90eb-a5a9e6ac784e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:29.437345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 594/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 02:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:29.442192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163f92-7118-43d7-8330-245339bb3fdf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:29.442643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163f92-7118-43d7-8330-245339bb3fdf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:29.442760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163f92-7118-43d7-8330-245339bb3fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:29.462174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1f163f92-7118-43d7-8330-245339bb3fdf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:29.463336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1f163f92-7118-43d7-8330-245339bb3fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:29.471089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 609/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 02:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:29.620361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9f59-0751-4aec-90eb-a5a9e6ac784e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:29.634925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9f59-0751-4aec-90eb-a5a9e6ac784e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:29.640847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58ad2-a909-4aa0-b60a-6fccdff697bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:29.641462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58ad2-a909-4aa0-b60a-6fccdff697bf service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:29.641738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58ad2-a909-4aa0-b60a-6fccdff697bf service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:29.642029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58ad2-a909-4aa0-b60a-6fccdff697bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:29.649933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58ad2-a909-4aa0-b60a-6fccdff697bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:29.651491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58ad2-a909-4aa0-b60a-6fccdff697bf service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:29.660569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 595/1204] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:33.589544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce285f7-1016-4547-b446-db7686750698 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:33.590109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce285f7-1016-4547-b446-db7686750698 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:33.590109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce285f7-1016-4547-b446-db7686750698 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:33.591456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 610/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:33.596710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f1a8-42cd-4d7b-a836-6e142d20c4f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:33.597144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f1a8-42cd-4d7b-a836-6e142d20c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:33.597264 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f1a8-42cd-4d7b-a836-6e142d20c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:33.616874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1c81f1a8-42cd-4d7b-a836-6e142d20c4f9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:33.618074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1c81f1a8-42cd-4d7b-a836-6e142d20c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:33.626427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 596/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:33.915366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce285f7-1016-4547-b446-db7686750698 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:33.917105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2ce285f7-1016-4547-b446-db7686750698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:33.943245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:33.996228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce285f7-1016-4547-b446-db7686750698 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:33.999704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256317ba-6517-4aca-bad1-662523e842f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:34.000304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256317ba-6517-4aca-bad1-662523e842f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:34.000577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256317ba-6517-4aca-bad1-662523e842f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:34.000846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256317ba-6517-4aca-bad1-662523e842f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:34.009513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256317ba-6517-4aca-bad1-662523e842f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:34.010931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256317ba-6517-4aca-bad1-662523e842f1 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:34.019984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 611/1207] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:36.146532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b839-0ca4-4a47-90e8-9ca213e16bb8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:36.146994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b839-0ca4-4a47-90e8-9ca213e16bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:36.147088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b839-0ca4-4a47-90e8-9ca213e16bb8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:36.148435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 597/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:36.153528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934fa5-5851-4abb-9d3b-22eba9f59be2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:36.153962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934fa5-5851-4abb-9d3b-22eba9f59be2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:36.154104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50934fa5-5851-4abb-9d3b-22eba9f59be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:36.174327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-50934fa5-5851-4abb-9d3b-22eba9f59be2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:36.175494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50934fa5-5851-4abb-9d3b-22eba9f59be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:36.183150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 612/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:36.466174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b839-0ca4-4a47-90e8-9ca213e16bb8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:36.468575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca53b839-0ca4-4a47-90e8-9ca213e16bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:36.481850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b839-0ca4-4a47-90e8-9ca213e16bb8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:36.485457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781b73b-0103-47dd-a9f1-b80e5ebce776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:36.486079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b73b-0103-47dd-a9f1-b80e5ebce776 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:36.486354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b73b-0103-47dd-a9f1-b80e5ebce776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:36.486622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b73b-0103-47dd-a9f1-b80e5ebce776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:36.495431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781b73b-0103-47dd-a9f1-b80e5ebce776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:36.496831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781b73b-0103-47dd-a9f1-b80e5ebce776 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:36.506273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 598/1210] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:40.267966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48e461-4e0a-468c-88b4-64008f2e5dd9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:40.268541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48e461-4e0a-468c-88b4-64008f2e5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:40.268541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48e461-4e0a-468c-88b4-64008f2e5dd9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:40.269934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 613/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:40.275265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f33e7-ceb0-42b2-a8e1-f70ccc2741d7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:40.275667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f33e7-ceb0-42b2-a8e1-f70ccc2741d7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:40.275812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f33e7-ceb0-42b2-a8e1-f70ccc2741d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:40.296429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3e6f33e7-ceb0-42b2-a8e1-f70ccc2741d7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:40.297657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3e6f33e7-ceb0-42b2-a8e1-f70ccc2741d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:40.305508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 599/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:40.604768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48e461-4e0a-468c-88b4-64008f2e5dd9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:40.606462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e48e461-4e0a-468c-88b4-64008f2e5dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:40.682115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48e461-4e0a-468c-88b4-64008f2e5dd9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:40.686218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df84978-bc5b-4ce4-80c9-f0fdea5181d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:40.686811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df84978-bc5b-4ce4-80c9-f0fdea5181d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:40.687091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df84978-bc5b-4ce4-80c9-f0fdea5181d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:40.687376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df84978-bc5b-4ce4-80c9-f0fdea5181d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:40.696248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df84978-bc5b-4ce4-80c9-f0fdea5181d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:40.697737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df84978-bc5b-4ce4-80c9-f0fdea5181d2 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:40.707574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 614/1213] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:42.852505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7af1f-5c60-4d6b-bbbe-f925489376bc None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:42.853088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7af1f-5c60-4d6b-bbbe-f925489376bc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:42.853088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7af1f-5c60-4d6b-bbbe-f925489376bc None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:42.854464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 600/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 02:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:09:42.859896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f34f2-7ea6-4237-be5a-5748b8602d32 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:42.860332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f34f2-7ea6-4237-be5a-5748b8602d32 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:42.860440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f34f2-7ea6-4237-be5a-5748b8602d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:42.880279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-278f34f2-7ea6-4237-be5a-5748b8602d32 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:42.881502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-278f34f2-7ea6-4237-be5a-5748b8602d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:42.889846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 615/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 02:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:43.191606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7af1f-5c60-4d6b-bbbe-f925489376bc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:43.193285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c9e7af1f-5c60-4d6b-bbbe-f925489376bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:43.206024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7af1f-5c60-4d6b-bbbe-f925489376bc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:43.209513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c4b0d-6bb9-4531-aac5-1e2d3f83566d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:43.210129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c4b0d-6bb9-4531-aac5-1e2d3f83566d service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:43.210403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c4b0d-6bb9-4531-aac5-1e2d3f83566d service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:43.210670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c4b0d-6bb9-4531-aac5-1e2d3f83566d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:43.219353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c4b0d-6bb9-4531-aac5-1e2d3f83566d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:43.220759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c4b0d-6bb9-4531-aac5-1e2d3f83566d service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:43.230190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 601/1216] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:52.875431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=66 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:53.225856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=34 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:08.600129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af599-8e81-4314-965b-97835c75d7c7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:08.601521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af599-8e81-4314-965b-97835c75d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:08.602323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af599-8e81-4314-965b-97835c75d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:08.633395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ce2af599-8e81-4314-965b-97835c75d7c7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:08.634977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ce2af599-8e81-4314-965b-97835c75d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:08.649483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 616/1217] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:08.660824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a75f-f682-4be0-b07e-55e4d855579f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:08.661467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a75f-f682-4be0-b07e-55e4d855579f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:08.661467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a75f-f682-4be0-b07e-55e4d855579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:08.689924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc64c-f3ad-47dc-9f5b-d9540272fa13 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:08.690599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc64c-f3ad-47dc-9f5b-d9540272fa13 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:08.691094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc64c-f3ad-47dc-9f5b-d9540272fa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:08.697685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8421a75f-f682-4be0-b07e-55e4d855579f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:08.698959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8421a75f-f682-4be0-b07e-55e4d855579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:08.711239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 602/1218] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:08.716157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421a75f-f682-4be0-b07e-55e4d855579f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:08.728246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dbadc64c-f3ad-47dc-9f5b-d9540272fa13 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:08.729988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dbadc64c-f3ad-47dc-9f5b-d9540272fa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:08.735611 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421a75f-f682-4be0-b07e-55e4d855579f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:08.746623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:08.747409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:08.747830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:08.748107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:08.748778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:08.749240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:08.750399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:11:08.750399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 02:11:08.750399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 02:11:08.751302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:08.751538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 617/1219] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:08.762652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8fc0-3da1-4bdc-b96c-32912be0825c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:08.764008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8fc0-3da1-4bdc-b96c-32912be0825c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:08.765394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8fc0-3da1-4bdc-b96c-32912be0825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:08.777670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 603/1220] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:11:08.778692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:08.790398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8f44-c9bd-4296-aa9d-350af90b98df admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:08.810026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:08.810678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:08.810955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:08.811226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:08.811881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:08.813831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:08.817450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f10f8fc0-3da1-4bdc-b96c-32912be0825c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:08.819338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f10f8fc0-3da1-4bdc-b96c-32912be0825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:08.839923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 618/1221] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:08.842264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeadeb-2312-42e4-9736-bb26013c08c6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:08.842560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeadeb-2312-42e4-9736-bb26013c08c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:08.842814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeadeb-2312-42e4-9736-bb26013c08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:08.890797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-eafeadeb-2312-42e4-9736-bb26013c08c6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:08.891909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eafeadeb-2312-42e4-9736-bb26013c08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:08.895565 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 604/1222] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:08 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:08.896426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.004791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 619/1223] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.006717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b3aea-2ad5-4dd4-a003-d81a9ed2bdb4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.007025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b3aea-2ad5-4dd4-a003-d81a9ed2bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.007419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b3aea-2ad5-4dd4-a003-d81a9ed2bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.018291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7cda-b61f-41b8-ae5f-5f35cb454e49 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.027333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.027957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.028238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.028508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.029192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:09.029496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.031101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.037159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f70b3aea-2ad5-4dd4-a003-d81a9ed2bdb4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.038634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f70b3aea-2ad5-4dd4-a003-d81a9ed2bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.045138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 605/1224] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:09.046029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.048475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 620/1225] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.050601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6065cb-5119-4b58-bf46-b844ba579635 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.051099 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6065cb-5119-4b58-bf46-b844ba579635 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.051604 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6065cb-5119-4b58-bf46-b844ba579635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.064280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1d8db-d729-4861-a8d7-c5c65a28398e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.070888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b25198-2a3e-4f7a-8f02-afd85ce568bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.071497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b25198-2a3e-4f7a-8f02-afd85ce568bd admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.071772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b25198-2a3e-4f7a-8f02-afd85ce568bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.072037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b25198-2a3e-4f7a-8f02-afd85ce568bd admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.072658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b25198-2a3e-4f7a-8f02-afd85ce568bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.073107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ee6065cb-5119-4b58-bf46-b844ba579635 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.073692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-f3b25198-2a3e-4f7a-8f02-afd85ce568bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:11:09.073692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 02:11:09.073692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 02:11:09.074346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ee6065cb-5119-4b58-bf46-b844ba579635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.074895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b25198-2a3e-4f7a-8f02-afd85ce568bd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.082368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 621/1226] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.084266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7415e-0c6f-4b7d-849d-5b6426959704 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.084571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7415e-0c6f-4b7d-849d-5b6426959704 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.085352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7415e-0c6f-4b7d-849d-5b6426959704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.098735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 606/1227] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.099962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d366-5d26-49a9-9183-a127356d5ebe None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.100252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d366-5d26-49a9-9183-a127356d5ebe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.100524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d366-5d26-49a9-9183-a127356d5ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.107450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-daf7415e-0c6f-4b7d-849d-5b6426959704 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.108782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-daf7415e-0c6f-4b7d-849d-5b6426959704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.119039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 622/1228] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.120266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177d331-e076-439d-9d29-fc78f1ce4957 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.120559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177d331-e076-439d-9d29-fc78f1ce4957 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.120842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177d331-e076-439d-9d29-fc78f1ce4957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.128146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b3d9d366-5d26-49a9-9183-a127356d5ebe None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.129589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b3d9d366-5d26-49a9-9183-a127356d5ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.137381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 607/1229] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.138201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9d366-5d26-49a9-9183-a127356d5ebe None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.141886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1177d331-e076-439d-9d29-fc78f1ce4957 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.143044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1177d331-e076-439d-9d29-fc78f1ce4957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.147544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9d366-5d26-49a9-9183-a127356d5ebe None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.151328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 623/1230] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.152550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846253-7f85-414d-9302-3d7a9335533c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.152837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846253-7f85-414d-9302-3d7a9335533c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.153146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846253-7f85-414d-9302-3d7a9335533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.157717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7b94-f819-4c26-adb9-2e4eeef1b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.158846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7b94-f819-4c26-adb9-2e4eeef1b9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.159123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7b94-f819-4c26-adb9-2e4eeef1b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.159390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7b94-f819-4c26-adb9-2e4eeef1b9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.160087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7b94-f819-4c26-adb9-2e4eeef1b9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.162036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7b94-f819-4c26-adb9-2e4eeef1b9c7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.176258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ad846253-7f85-414d-9302-3d7a9335533c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.177602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ad846253-7f85-414d-9302-3d7a9335533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.186609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 624/1231] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.191132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 608/1232] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.191974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4754d-8739-444d-a79b-1a6b37f4c30d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.192269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4754d-8739-444d-a79b-1a6b37f4c30d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.192548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4754d-8739-444d-a79b-1a6b37f4c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.192665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3136563-2a41-4525-bb2f-cc4de131368a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.192922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3136563-2a41-4525-bb2f-cc4de131368a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.193226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3136563-2a41-4525-bb2f-cc4de131368a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.212734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c3136563-2a41-4525-bb2f-cc4de131368a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.213189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ece4754d-8739-444d-a79b-1a6b37f4c30d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.213986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c3136563-2a41-4525-bb2f-cc4de131368a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.214355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ece4754d-8739-444d-a79b-1a6b37f4c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.265715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:09.276108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 625/1233] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.285219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4754d-8739-444d-a79b-1a6b37f4c30d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.285339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 609/1234] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.285339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b169-93e2-4b36-ba05-44b403308a30 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.285339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b169-93e2-4b36-ba05-44b403308a30 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.285339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b169-93e2-4b36-ba05-44b403308a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.295304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4754d-8739-444d-a79b-1a6b37f4c30d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.299597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0d14b169-93e2-4b36-ba05-44b403308a30 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.300619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d433a8-9371-482b-8367-678baf69e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.300775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d433a8-9371-482b-8367-678baf69e8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.300873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0d14b169-93e2-4b36-ba05-44b403308a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.301087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d433a8-9371-482b-8367-678baf69e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.301364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d433a8-9371-482b-8367-678baf69e8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.302011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d433a8-9371-482b-8367-678baf69e8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.303614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d433a8-9371-482b-8367-678baf69e8f0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.308967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 610/1235] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.312471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b169-93e2-4b36-ba05-44b403308a30 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.320080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 626/1236] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:09.320080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3a61d-3ae1-4199-9b19-d076524d42e2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.320080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3a61d-3ae1-4199-9b19-d076524d42e2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.320478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b169-93e2-4b36-ba05-44b403308a30 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.320582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3a61d-3ae1-4199-9b19-d076524d42e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.323601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.324184 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.324460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.324730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.325399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:09.325698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.327274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.339325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9aa3a61d-3ae1-4199-9b19-d076524d42e2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.340387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 611/1237] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:09.340525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9aa3a61d-3ae1-4199-9b19-d076524d42e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.341214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.351483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c74a-f0cd-4dfd-b8d1-6973090317df admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.355887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 627/1238] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.355887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3a61d-3ae1-4199-9b19-d076524d42e2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.360013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.360613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.360891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.361207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.361822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:09.362124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.362326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3a61d-3ae1-4199-9b19-d076524d42e2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.363701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.366914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c3572-417b-4acd-9ce4-c7b8e5510bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.367496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3572-417b-4acd-9ce4-c7b8e5510bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.367773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3572-417b-4acd-9ce4-c7b8e5510bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.368045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c3572-417b-4acd-9ce4-c7b8e5510bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.368673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c3572-417b-4acd-9ce4-c7b8e5510bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.371047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c3572-417b-4acd-9ce4-c7b8e5510bb3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.375627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 612/1239] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:09.376404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.385968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965622fe-57d4-452d-bc03-ac0bfa620965 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.391285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.391875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.392203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.392933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.393625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:09.393926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.395504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.399904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 628/1240] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.399904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2887a5-f9af-4338-8612-92660cde08ef None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.399904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2887a5-f9af-4338-8612-92660cde08ef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.399904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2887a5-f9af-4338-8612-92660cde08ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.409013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 613/1241] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:09.409013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.418207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd561-d0f7-4809-bafb-9467a2e72b66 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.422858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.423431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.424235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.424508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.425169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:09.425297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9a2887a5-f9af-4338-8612-92660cde08ef None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:09.425466 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.426483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9a2887a5-f9af-4338-8612-92660cde08ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:09.427024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.434462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 629/1242] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:09.435169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2887a5-f9af-4338-8612-92660cde08ef None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.447249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 614/1243] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:09.447249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.450601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b153d0-5147-4652-b90e-defd208e30ea admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.451467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2887a5-f9af-4338-8612-92660cde08ef None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.455935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.456508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.456722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.456833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.457074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.457352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.457636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.457738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.457908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.458551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.459548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.460135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.461527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:09.473087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 630/1244] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:09.474139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.484962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f106ff5-9eb8-4c2e-9848-771a415c74fc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.492836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 615/1245] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.493026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.493026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.493241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.493331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.493331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.493331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:09.493331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.493771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.506448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 631/1246] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:09.507259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.516762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1921ad-ebd7-48ab-bb19-23b8d8601d70 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.558376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15178b-95d5-40ee-ac4c-17532f80b265 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.563254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.563757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.564042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.564343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.565026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.566956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.572451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.573084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.573368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.573635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.574266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.575841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.585882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 632/1247] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:09.586807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.597075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb3594-d291-4407-a966-83d8aaaf22f6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.599263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 616/1248] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.600150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.602512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.603703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.603957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.604228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.604848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.605898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:11:09.605898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 02:11:09.605898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 02:11:09.607076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.634303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 633/1249] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.635103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.663308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766276b-f218-4f2b-8964-b5a55b653e72 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.667893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:09.697523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da81f2-a62a-477e-b5cc-be607299aef1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.702128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.702737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.703013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.703281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.703900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.705885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.720119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.721506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.721784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.722052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.722688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:09.722984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.724556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.738076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 634/1250] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.738724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 617/1251] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:09.738959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.739810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.750920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16705c-8a6d-46ba-931f-4e1fb544410a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.788003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:09.805999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea18238-6af3-4fc5-99e4-60be1da2048e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.808289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.808899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.809215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.809490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.810113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.810665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.811315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.811590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.811858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] PATH_INFO: `/v3/projects/e1f481fd4ef64aa19b3edfddaa21e6c9/users/10e74aaba7cc4b038b5028a76e78feab/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.812041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.829002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f481fd4ef64aa19b3edfddaa21e6c9, user_id=10e74aaba7cc4b038b5028a76e78feab, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.831718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.833891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 618/1252] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.834692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.846073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 635/1253] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:09 2022] PUT /identity/v3/projects/e1f481fd4ef64aa19b3edfddaa21e6c9/users/10e74aaba7cc4b038b5028a76e78feab/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:09.846974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.850068 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a99f2e-772b-4118-b84e-753879fa3ed5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.904708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.905353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.905636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.905911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.906540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.909186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.909623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c50b4-b8cf-436d-bf22-8068fe985b6b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.914302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.914842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:09.915133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:09.915412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:09.916025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:09.917654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:09.928658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 636/1254] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:09.929588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.939423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e4384-2484-4a2c-946c-50981ae4425a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:09.944538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 619/1255] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:09.944538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:09.960423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:09.999290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:09.999903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.000182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.000447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.001089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.003067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.004963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30955-4593-443f-ae8d-f3c4adcaf35a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.009612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.010221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.010501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.010813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.011438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.013498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.024715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 637/1256] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:10.025623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.035364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edbe6f-2d47-4a55-845f-f940cad19eb6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.040921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 620/1257] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:09 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:10.040921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.041187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.041187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.041187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.041445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.042065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.043975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.048484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f376-5367-4aac-a612-7156bb83cd22 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.055007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3f2a0-204b-4462-a182-e87b00058a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.056153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3f2a0-204b-4462-a182-e87b00058a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.056470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3f2a0-204b-4462-a182-e87b00058a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.056841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3f2a0-204b-4462-a182-e87b00058a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.057598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3f2a0-204b-4462-a182-e87b00058a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.060104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3f2a0-204b-4462-a182-e87b00058a81 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.065595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 638/1258] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:10.066494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.076040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d75f12-9360-4c51-92c7-78dc739bcd8d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.081426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.082015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.082292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.082707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.083188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.084764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.091429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 621/1259] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:10.091429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bad95-9ec3-4c7d-8da1-ca13b652e9aa None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.091429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bad95-9ec3-4c7d-8da1-ca13b652e9aa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.091429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bad95-9ec3-4c7d-8da1-ca13b652e9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.096921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 639/1260] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.097797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.107588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa8d8-4d12-4fdb-b8b7-e0e8e6294d37 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.108811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a02bad95-9ec3-4c7d-8da1-ca13b652e9aa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:10.110134 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a02bad95-9ec3-4c7d-8da1-ca13b652e9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:10.126910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:10.166185 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.166767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.167055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.167335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] PATH_INFO: `/v3/projects/c087ea49d3c54e7180022c801c5ece4b/users/ab8ab12109f34f0ab1d13b1cf2d375d0/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.168704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 622/1261] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:10.169554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bad95-9ec3-4c7d-8da1-ca13b652e9aa None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.179189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bad95-9ec3-4c7d-8da1-ca13b652e9aa None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.184026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.184706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.185007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.185277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.185899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.186974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c087ea49d3c54e7180022c801c5ece4b, user_id=ab8ab12109f34f0ab1d13b1cf2d375d0, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.187788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.189961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.203671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 640/1262] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:10 2022] PUT /identity/v3/projects/c087ea49d3c54e7180022c801c5ece4b/users/ab8ab12109f34f0ab1d13b1cf2d375d0/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:10.205427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.213390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 623/1263] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:10.214013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.224057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2fe0-7197-444e-9dad-85fe923a77d0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.275065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b916f8-c0a3-4782-abd0-5d39cacef9e5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.279739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.280346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.280625 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.280897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.281011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.281568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.281701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.281871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.282140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.282790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.283709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.284930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.293469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 641/1264] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.294271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.297462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 624/1265] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.297462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.302507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:10.306048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b27c6-3a85-4a5d-a169-aafcfe1de124 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.306871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cc646-b013-4f2d-985a-f4449a7d6a42 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.311607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.312202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.312305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.312480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.312748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.312903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.313211 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.313434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.313532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.314086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.315043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.316009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.324959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 642/1266] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.325745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.336675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a14cd-0c6e-4b7c-b67f-45c94b45909a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.343460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 625/1267] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:10.343628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306f0a1-bb34-4ad7-99d6-c29a43d97327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.343746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.343847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306f0a1-bb34-4ad7-99d6-c29a43d97327 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.343847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306f0a1-bb34-4ad7-99d6-c29a43d97327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.343847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306f0a1-bb34-4ad7-99d6-c29a43d97327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.343847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306f0a1-bb34-4ad7-99d6-c29a43d97327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.344548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306f0a1-bb34-4ad7-99d6-c29a43d97327 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.358781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 643/1268] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.358781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc708-ee37-41c0-b9d2-724a4753fa8a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.358781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc708-ee37-41c0-b9d2-724a4753fa8a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.358781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc708-ee37-41c0-b9d2-724a4753fa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.375497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-683fc708-ee37-41c0-b9d2-724a4753fa8a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:10.376668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-683fc708-ee37-41c0-b9d2-724a4753fa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:10.384753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 644/1269] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:10.385390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc708-ee37-41c0-b9d2-724a4753fa8a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.398926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc708-ee37-41c0-b9d2-724a4753fa8a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.399329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab2539-d051-4a5a-8c99-d1ed5440410a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.402966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.403445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.403575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.403844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.404057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.404159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.404320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.404600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.405293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.406898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.413249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.414681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.416794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 645/1270] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.417545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.424518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 626/1271] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:10.425344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.431666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6510cf-1e48-40c7-a96c-4777ac4a5ef9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.434822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abbc13-504e-443b-bf59-9e2ff5e2a6d3 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.436715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.437422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.437768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.438526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.438802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.441096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.441245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.441827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.442271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.442520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.443255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.444940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.452605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 646/1272] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.456394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.456534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 627/1273] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.457455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.467185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69d7fa-c1ad-42c1-89fb-11f31948f58e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.467670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372d87-861b-4639-9070-a754dfbcfbdc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.472496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.472883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.473054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.473333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.473604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.473721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.474049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.474236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.474442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.475151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.475977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.476855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.489004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 647/1274] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.489809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.496609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 628/1275] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.496609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.502764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feac79a-0829-4052-90a9-db618213a221 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.507411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94106f-4be9-436e-b2a1-51717eec94bb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.508419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.509144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.509430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.509722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] PATH_INFO: `/v3/projects/5506be3c5f8b40818fbac09a1e205a47/users/3b1d073ea32449458376dea2ab919a48/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.512161 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.514169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.514628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.515074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.527325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5506be3c5f8b40818fbac09a1e205a47, user_id=3b1d073ea32449458376dea2ab919a48, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.527513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.528831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.530620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.540059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 629/1276] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:10.540641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.552588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd6e7b-4c3c-401d-8ff3-398e3fec40d3 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.557244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 648/1277] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:10 2022] PUT /identity/v3/projects/5506be3c5f8b40818fbac09a1e205a47/users/3b1d073ea32449458376dea2ab919a48/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:10.558162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.580501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:10.626811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.627986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.628422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.628931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.629980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.631919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.640795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7c452-dc5a-42e3-b5f8-3ed8b5115694 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.649211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.649211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.649211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.649211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] PATH_INFO: `/v3/projects/6215d846196a45b4ba585f7a288389fd/users/0df474adad794cf6b1211cd916f02375/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.650228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 630/1278] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.651825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.665982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca02c-60da-42f6-a75f-c4230c7df68f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.669204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6215d846196a45b4ba585f7a288389fd, user_id=0df474adad794cf6b1211cd916f02375, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.672114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.672919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.673190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.673328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.673498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] PATH_INFO: `/v3/projects/07544aa0b7644737beaec8e1c0642440/users/3026f421625345da9741ad2175b46fcf/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.694190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=07544aa0b7644737beaec8e1c0642440, user_id=3026f421625345da9741ad2175b46fcf, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.694468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 649/1279] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:10 2022] PUT /identity/v3/projects/6215d846196a45b4ba585f7a288389fd/users/0df474adad794cf6b1211cd916f02375/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:10.695444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.698257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.716892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 631/1280] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:10 2022] PUT /identity/v3/projects/07544aa0b7644737beaec8e1c0642440/users/3026f421625345da9741ad2175b46fcf/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:10.717987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.764660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:10.808751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c61750-b092-4d01-8cb0-58b4b0d7f4eb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.816575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e8234-34c7-4c8d-b720-be04c4e640d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.817338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e8234-34c7-4c8d-b720-be04c4e640d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.817680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e8234-34c7-4c8d-b720-be04c4e640d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.818007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e8234-34c7-4c8d-b720-be04c4e640d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.819028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e8234-34c7-4c8d-b720-be04c4e640d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.820838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e8234-34c7-4c8d-b720-be04c4e640d2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.831450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fef62-ce1b-47e5-a60d-25ac1d47c482 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.837020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e214e-5cbb-44b4-b08c-f1585a3d16bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.840177 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 632/1281] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:10.840327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e214e-5cbb-44b4-b08c-f1585a3d16bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.840327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e214e-5cbb-44b4-b08c-f1585a3d16bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.840327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e214e-5cbb-44b4-b08c-f1585a3d16bc admin admin] PATH_INFO: `/v3/projects/feeb266c13fc4c01a3a07618d7b1625b/users/0037e6edc2b440b887597aa419540efb/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.840597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19365d0-da71-4702-ac4c-2d049da057c2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.840597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19365d0-da71-4702-ac4c-2d049da057c2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.840597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19365d0-da71-4702-ac4c-2d049da057c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.856855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e214e-5cbb-44b4-b08c-f1585a3d16bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=feeb266c13fc4c01a3a07618d7b1625b, user_id=0037e6edc2b440b887597aa419540efb, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.860014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e214e-5cbb-44b4-b08c-f1585a3d16bc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:10.862499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f19365d0-da71-4702-ac4c-2d049da057c2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:10.863955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f19365d0-da71-4702-ac4c-2d049da057c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:10.874323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 633/1282] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:10.875415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19365d0-da71-4702-ac4c-2d049da057c2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:10.879369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 650/1283] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:10 2022] PUT /identity/v3/projects/feeb266c13fc4c01a3a07618d7b1625b/users/0037e6edc2b440b887597aa419540efb/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:10.880739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92373-0924-4380-86dd-1ac2db58c305 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.881113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92373-0924-4380-86dd-1ac2db58c305 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.881396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92373-0924-4380-86dd-1ac2db58c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.890203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19365d0-da71-4702-ac4c-2d049da057c2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:10.916056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9ac92373-0924-4380-86dd-1ac2db58c305 None None] MFA Rules not processed for user `0df474adad794cf6b1211cd916f02375`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:10.917047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9ac92373-0924-4380-86dd-1ac2db58c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:10.960514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:10.961384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:10.961677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:10.962028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] PATH_INFO: `/v3/projects/27a9bbc390d540aeac485cace4274cff/users/233fb55c171f44ea955ba2f5ac67858f/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:10.978945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9bbc390d540aeac485cace4274cff, user_id=233fb55c171f44ea955ba2f5ac67858f, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:10.984218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.003300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 651/1284] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:11.004833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412e7c3-2f3e-4da8-9fe5-ec52515f466f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.005269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412e7c3-2f3e-4da8-9fe5-ec52515f466f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.005784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412e7c3-2f3e-4da8-9fe5-ec52515f466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.009173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 634/1285] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:10 2022] PUT /identity/v3/projects/27a9bbc390d540aeac485cace4274cff/users/233fb55c171f44ea955ba2f5ac67858f/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:11.010290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.049242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:11.059512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5412e7c3-2f3e-4da8-9fe5-ec52515f466f None None] MFA Rules not processed for user `3026f421625345da9741ad2175b46fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:11.061416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5412e7c3-2f3e-4da8-9fe5-ec52515f466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:11.151183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bc3bb-a517-4aac-9815-b4b05c4a4162 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.157023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 652/1286] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:11.157186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:11.157761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.158673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.158963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] PATH_INFO: `/v3/projects/20cfdf13a162457a82cdd793d91973cc/users/be16189fa09d4c70b600601d941e31fb/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.159825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea309-cba8-4246-aa66-568b88be2b0e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.160503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea309-cba8-4246-aa66-568b88be2b0e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.160915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea309-cba8-4246-aa66-568b88be2b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.179661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cfdf13a162457a82cdd793d91973cc, user_id=be16189fa09d4c70b600601d941e31fb, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:11.182595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.201610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 635/1287] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:11 2022] PUT /identity/v3/projects/20cfdf13a162457a82cdd793d91973cc/users/be16189fa09d4c70b600601d941e31fb/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:11.205406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.227611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0f9ea309-cba8-4246-aa66-568b88be2b0e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:11.231439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f9ea309-cba8-4246-aa66-568b88be2b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:11.270898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:11.337954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce48b19-3931-4773-b72e-35b9c8a36ecb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.340913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 653/1288] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:11.342215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ea309-cba8-4246-aa66-568b88be2b0e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.349918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55f2e1-f2e3-42db-8d34-93e3bfe71acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:11.350035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55f2e1-f2e3-42db-8d34-93e3bfe71acf service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.350289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55f2e1-f2e3-42db-8d34-93e3bfe71acf service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.350738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55f2e1-f2e3-42db-8d34-93e3bfe71acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.357292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ea309-cba8-4246-aa66-568b88be2b0e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.368360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e0baa-f710-4f5a-a27b-07827b8b89ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:11.369582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0baa-f710-4f5a-a27b-07827b8b89ec admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.370375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0baa-f710-4f5a-a27b-07827b8b89ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.370656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e0baa-f710-4f5a-a27b-07827b8b89ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.371537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e0baa-f710-4f5a-a27b-07827b8b89ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:11.373945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e0baa-f710-4f5a-a27b-07827b8b89ec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.375963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55f2e1-f2e3-42db-8d34-93e3bfe71acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:11.378632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55f2e1-f2e3-42db-8d34-93e3bfe71acf service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.403294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 636/1289] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:11.405348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14a9c-285d-4ef9-b602-b85b7ef9db82 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.405648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14a9c-285d-4ef9-b602-b85b7ef9db82 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.405947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14a9c-285d-4ef9-b602-b85b7ef9db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.425190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 654/1290] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:11.425190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909bf7-3ea7-45c0-a962-44f7af68105e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.425190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909bf7-3ea7-45c0-a962-44f7af68105e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.425190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909bf7-3ea7-45c0-a962-44f7af68105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.463994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-90909bf7-3ea7-45c0-a962-44f7af68105e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:11.466665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-90909bf7-3ea7-45c0-a962-44f7af68105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:11.471038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-50f14a9c-285d-4ef9-b602-b85b7ef9db82 None None] MFA Rules not processed for user `233fb55c171f44ea955ba2f5ac67858f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:11.472282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-50f14a9c-285d-4ef9-b602-b85b7ef9db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:11.593879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 655/1291] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:11.595626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247647c-b5c2-49d2-be6d-eb549d767f2b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.595923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247647c-b5c2-49d2-be6d-eb549d767f2b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.596202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247647c-b5c2-49d2-be6d-eb549d767f2b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.602910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 656/1292] 10.222.0.25 () {54 vars in 961 bytes} [Sun Oct 23 02:11:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:11.603963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247647c-b5c2-49d2-be6d-eb549d767f2b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.620583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 637/1293] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:11.620583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f14a9c-285d-4ef9-b602-b85b7ef9db82 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.637345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f14a9c-285d-4ef9-b602-b85b7ef9db82 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.643458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0075d-02a6-4c69-88e5-faa4f0699aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:11.644189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0075d-02a6-4c69-88e5-faa4f0699aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.644649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0075d-02a6-4c69-88e5-faa4f0699aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.644927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0075d-02a6-4c69-88e5-faa4f0699aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.645614 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0075d-02a6-4c69-88e5-faa4f0699aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:11.646918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:11.647780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0075d-02a6-4c69-88e5-faa4f0699aa7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.679519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 638/1294] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/users => generated 309 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:11.681084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a5f8-1452-4178-af1e-b56cfcaa9c92 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.681374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a5f8-1452-4178-af1e-b56cfcaa9c92 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.681652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a5f8-1452-4178-af1e-b56cfcaa9c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.699498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247647c-b5c2-49d2-be6d-eb549d767f2b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.708055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:11.709060 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.709493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.711211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.724455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:11.726132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.740856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bb76a5f8-1452-4178-af1e-b56cfcaa9c92 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:11.744425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bb76a5f8-1452-4178-af1e-b56cfcaa9c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:11.752834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 657/1295] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:11.753927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.768765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7c9a3-a575-48fa-b6ae-63250cd5104e service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.773851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:11.775034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.775319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.775760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.789450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:11.792830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.810789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 658/1296] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:11.812253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.830910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58be0ae-da0e-486b-92a2-ade7c592e55a service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.839776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:11.840843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:11.841441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:11.841751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:11.842601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:11.844811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:11.878017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 639/1297] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:11.878846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a5f8-1452-4178-af1e-b56cfcaa9c92 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.897684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 659/1298] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:11 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:11.897684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:11.906751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a5f8-1452-4178-af1e-b56cfcaa9c92 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:11.930988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:12.041256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3d943-d05b-4f40-b44b-54db187ce4e8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.054119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.054874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.055078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.055392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.056322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.056951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.057252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.057518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.058212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.059761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.077428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 640/1299] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:12.078273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.105313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac6231-a615-4306-a4c4-87974847e815 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.112645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.113386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.118101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.118472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.119725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.121896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.153033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 641/1300] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:12 2022] POST /identity/v3/users => generated 293 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:12.153033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.167570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b2a86-6012-4253-9419-d399ee07df68 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.170967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.172619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.173508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.173843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.174138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.174413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] PATH_INFO: `/v3/projects/9d8d0d38cbca4a8e95281e756567439e/users/5646df50fc6d4e15bf9a9639edbfcde0/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.191359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 660/1301] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:12.192857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.207448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8d0d38cbca4a8e95281e756567439e, user_id=5646df50fc6d4e15bf9a9639edbfcde0, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.210232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.211895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82ad6-de85-4421-a300-83f245f0731d service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.217872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.218740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.219178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.219617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.221053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.223771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.240141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 661/1303] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:12.241540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 642/1303] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:12 2022] PUT /identity/v3/projects/9d8d0d38cbca4a8e95281e756567439e/users/5646df50fc6d4e15bf9a9639edbfcde0/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:12.243783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.245815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.270239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5619-43ea-40e9-9beb-99f1592f57b9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.295261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:12.352827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec37ed-c370-44a1-9e55-8f3d9058c60a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.355082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.355715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.355997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.356273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.357105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.359256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.366582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.368720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.371231 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.371772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] PATH_INFO: `/v3/projects/0169a511c0994d6daaa2d48b53f0876b/users/3cf7d7df522642e39eb9108b80dfc40c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.372188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 662/1304] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:11:12.375947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.388686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c5c0f-c56d-4e22-8ccf-83160f1fb8f0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.397140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb6685-5042-4da5-b518-e31324a096a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.398774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6685-5042-4da5-b518-e31324a096a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.399175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6685-5042-4da5-b518-e31324a096a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.399549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6685-5042-4da5-b518-e31324a096a6 admin admin] PATH_INFO: `/v3/projects/9d8d0d38cbca4a8e95281e756567439e/users/5646df50fc6d4e15bf9a9639edbfcde0/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.402496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb6685-5042-4da5-b518-e31324a096a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8d0d38cbca4a8e95281e756567439e, user_id=5646df50fc6d4e15bf9a9639edbfcde0, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.405445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb6685-5042-4da5-b518-e31324a096a6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.411301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0169a511c0994d6daaa2d48b53f0876b, user_id=3cf7d7df522642e39eb9108b80dfc40c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.414698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.422871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 663/1305] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:12 2022] PUT /identity/v3/projects/9d8d0d38cbca4a8e95281e756567439e/users/5646df50fc6d4e15bf9a9639edbfcde0/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:12.435141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b1f0e-7a21-4eef-915d-09dcd16735e8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.435739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b1f0e-7a21-4eef-915d-09dcd16735e8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.436214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b1f0e-7a21-4eef-915d-09dcd16735e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.451956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 643/1306] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:12 2022] PUT /identity/v3/projects/0169a511c0994d6daaa2d48b53f0876b/users/3cf7d7df522642e39eb9108b80dfc40c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:12.452844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.472314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-502b1f0e-7a21-4eef-915d-09dcd16735e8 None None] MFA Rules not processed for user `5646df50fc6d4e15bf9a9639edbfcde0`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:12.473706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-502b1f0e-7a21-4eef-915d-09dcd16735e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:12.574341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 664/1307] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:12.574914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:12.584753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b1f0e-7a21-4eef-915d-09dcd16735e8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.592898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9ed55-adb4-4c8a-a439-b4172ac76292 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.608608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba092be-12cf-48f6-ac67-d9a1b31c06ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.610512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092be-12cf-48f6-ac67-d9a1b31c06ce admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.612055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092be-12cf-48f6-ac67-d9a1b31c06ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.612428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092be-12cf-48f6-ac67-d9a1b31c06ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.613544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba092be-12cf-48f6-ac67-d9a1b31c06ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.615718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba092be-12cf-48f6-ac67-d9a1b31c06ce admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.630980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 644/1308] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:12.632228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c560-6e55-4704-9a81-220573a26af5 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.632637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c560-6e55-4704-9a81-220573a26af5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.633353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c560-6e55-4704-9a81-220573a26af5 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.636226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 645/1309] 10.222.0.25 () {54 vars in 912 bytes} [Sun Oct 23 02:11:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:12.643908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403c560-6e55-4704-9a81-220573a26af5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.664717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403c560-6e55-4704-9a81-220573a26af5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.672182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776c33-5d16-4b68-a56a-4d29238bc748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.673200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776c33-5d16-4b68-a56a-4d29238bc748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.673539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776c33-5d16-4b68-a56a-4d29238bc748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.674150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776c33-5d16-4b68-a56a-4d29238bc748 admin admin] PATH_INFO: `/v3/projects/0169a511c0994d6daaa2d48b53f0876b/users/3cf7d7df522642e39eb9108b80dfc40c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.676968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93776c33-5d16-4b68-a56a-4d29238bc748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0169a511c0994d6daaa2d48b53f0876b, user_id=3cf7d7df522642e39eb9108b80dfc40c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.679264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b1f0e-7a21-4eef-915d-09dcd16735e8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:12.679849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93776c33-5d16-4b68-a56a-4d29238bc748 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.683662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ceda6-2fd9-45b8-b1e4-516988e17a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:12.684718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ceda6-2fd9-45b8-b1e4-516988e17a7f service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.685141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ceda6-2fd9-45b8-b1e4-516988e17a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.685683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ceda6-2fd9-45b8-b1e4-516988e17a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.707096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 646/1310] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:12 2022] PUT /identity/v3/projects/0169a511c0994d6daaa2d48b53f0876b/users/3cf7d7df522642e39eb9108b80dfc40c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:12.707096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9637fc-31d3-4472-a2fe-a13d207c1868 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.707096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9637fc-31d3-4472-a2fe-a13d207c1868 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.707096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9637fc-31d3-4472-a2fe-a13d207c1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.707707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ceda6-2fd9-45b8-b1e4-516988e17a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:12.707707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ceda6-2fd9-45b8-b1e4-516988e17a7f service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:12.729599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 665/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:12 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:11:12.731745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5c35-ae79-4c67-9e05-b9bf042a3efb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:12.732170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5c35-ae79-4c67-9e05-b9bf042a3efb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:12.732544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5c35-ae79-4c67-9e05-b9bf042a3efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:12.750190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9b9637fc-31d3-4472-a2fe-a13d207c1868 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:12.752838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9b9637fc-31d3-4472-a2fe-a13d207c1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:12.771676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ccdd5c35-ae79-4c67-9e05-b9bf042a3efb None None] MFA Rules not processed for user `3cf7d7df522642e39eb9108b80dfc40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:12.773326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ccdd5c35-ae79-4c67-9e05-b9bf042a3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:12.791911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:12.918766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 666/1312] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:12.932630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd5c35-ae79-4c67-9e05-b9bf042a3efb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:12.943436 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 647/1313] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:11:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:12.990975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9637fc-31d3-4472-a2fe-a13d207c1868 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:13.075432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd5c35-ae79-4c67-9e05-b9bf042a3efb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:13.091028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:13.093948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:13.093948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:13.095012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:13.124133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:13.125826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:13.146794 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9637fc-31d3-4472-a2fe-a13d207c1868 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:13.152371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:13.153263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:13.154626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:13.154986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:13.155687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 667/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:13.178042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:13.179700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:13.202322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 648/1315] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:13.445978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:13.454086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:13.466488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf02fd-26e1-4c03-8c2f-d6e0dc99b36c service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:13.472587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304707ce-73d0-4ada-9561-5a653426fc25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:13.473268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304707ce-73d0-4ada-9561-5a653426fc25 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:13.473548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304707ce-73d0-4ada-9561-5a653426fc25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:13.473831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304707ce-73d0-4ada-9561-5a653426fc25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:13.570055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e5511-b115-484d-afa9-d4f0a0ab18b3 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:13.582991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:13.583758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:13.583990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:13.584274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] PATH_INFO: `/v3/users/0df474adad794cf6b1211cd916f02375` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:13.585599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df474adad794cf6b1211cd916f02375)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:13.588135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:11:13.588135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 23 02:11:13.588135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: Oct 23 02:11:13.589203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:13.630451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304707ce-73d0-4ada-9561-5a653426fc25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:13.633795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304707ce-73d0-4ada-9561-5a653426fc25 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:13.658817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 649/1316] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:13.721302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df474adad794cf6b1211cd916f02375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:13.731636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:13.737747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df474adad794cf6b1211cd916f02375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:13.738847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df474adad794cf6b1211cd916f02375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:13.739627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df474adad794cf6b1211cd916f02375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:13.774908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df474adad794cf6b1211cd916f02375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:13.809375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 668/1317] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:13 2022] DELETE /identity/v3/users/0df474adad794cf6b1211cd916f02375 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:13.811486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7e66-7f80-4a8b-8ee2-15ef491027ff None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:13.811978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7e66-7f80-4a8b-8ee2-15ef491027ff None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:13.811978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7e66-7f80-4a8b-8ee2-15ef491027ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:13.865637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3b8c7e66-7f80-4a8b-8ee2-15ef491027ff None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:13.866887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3b8c7e66-7f80-4a8b-8ee2-15ef491027ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:13.875402 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:14.034382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 650/1318] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:14.112282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:14.114922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:14.330914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7fd1-e768-4762-8702-6b212bb77d2c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:14.341584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce452e-5e03-4cc9-93e4-580fdbe2b818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:14.342242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce452e-5e03-4cc9-93e4-580fdbe2b818 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.342534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce452e-5e03-4cc9-93e4-580fdbe2b818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.343400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce452e-5e03-4cc9-93e4-580fdbe2b818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.361429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce452e-5e03-4cc9-93e4-580fdbe2b818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:14.362820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce452e-5e03-4cc9-93e4-580fdbe2b818 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:14.388916 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 669/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:14.612693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279bc1d-c393-40e7-b023-4e49dc3922e0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.613185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279bc1d-c393-40e7-b023-4e49dc3922e0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.613847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279bc1d-c393-40e7-b023-4e49dc3922e0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.615227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 651/1320] 10.222.0.25 () {54 vars in 961 bytes} [Sun Oct 23 02:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:14.623683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f89f1-b8d9-4542-bcb0-d8b83f9026a7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.624317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f89f1-b8d9-4542-bcb0-d8b83f9026a7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.624702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f89f1-b8d9-4542-bcb0-d8b83f9026a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.662070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-202f89f1-b8d9-4542-bcb0-d8b83f9026a7 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:14.663042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-202f89f1-b8d9-4542-bcb0-d8b83f9026a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:14.784843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 670/1321] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Oct 23 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:14.790460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe447-fa2e-460f-9bdb-07aab2cf4922 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.790763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe447-fa2e-460f-9bdb-07aab2cf4922 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.791005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe447-fa2e-460f-9bdb-07aab2cf4922 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.792366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 652/1322] 10.222.0.25 () {54 vars in 912 bytes} [Sun Oct 23 02:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:14.797920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.798243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.798468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.832442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:14.834260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:14.865017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 671/1323] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:14.872107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe447-fa2e-460f-9bdb-07aab2cf4922 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:14.874875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-30dfe447-fa2e-460f-9bdb-07aab2cf4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:14.977911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe447-fa2e-460f-9bdb-07aab2cf4922 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:14.981845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:14.982732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.982935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.983213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.998940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:15.012672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:15.031458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 653/1324] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:16.600373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:16.603983 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:16.645926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc9b93-d8ae-4468-a0c4-704c7bf832d9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:16.672089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:16.675251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:16.675552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:16.676695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] PATH_INFO: `/v3/projects/6215d846196a45b4ba585f7a288389fd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:16.682759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6215d846196a45b4ba585f7a288389fd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:16.690472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:16.873779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6215d846196a45b4ba585f7a288389fd', 'request_id': 'req-0dad9755-56d5-48ab-b0d7-81dae94a3236'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:16.885451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:16.900729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6215d846196a45b4ba585f7a288389fd', 'request_id': 'req-0dad9755-56d5-48ab-b0d7-81dae94a3236'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:16.914734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6215d846196a45b4ba585f7a288389fd', 'request_id': 'req-0dad9755-56d5-48ab-b0d7-81dae94a3236'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:16.962869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] The token cache is being invalidate because project 6215d846196a45b4ba585f7a288389fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:16.966350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:16.968161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:16.976794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 672/1325] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:16 2022] DELETE /identity/v3/projects/6215d846196a45b4ba585f7a288389fd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:16.981428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:17.001612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beb64a-015b-4112-81ce-a31ce607978b service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:17.157164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:17.159672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:17.161092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:17.162126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] PATH_INFO: `/v3/users/5646df50fc6d4e15bf9a9639edbfcde0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:17.165805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5646df50fc6d4e15bf9a9639edbfcde0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:17.167950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:17.303064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5646df50fc6d4e15bf9a9639edbfcde0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:17.303973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5646df50fc6d4e15bf9a9639edbfcde0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:17.317404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5646df50fc6d4e15bf9a9639edbfcde0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:17.318211 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5646df50fc6d4e15bf9a9639edbfcde0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:17.320042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:17.344312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1895e6f-8b0d-4604-9058-37e80de3bc39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5646df50fc6d4e15bf9a9639edbfcde0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:17.370582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 654/1326] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:16 2022] DELETE /identity/v3/users/5646df50fc6d4e15bf9a9639edbfcde0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:18.987827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:18.991011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:19.019881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad9755-56d5-48ab-b0d7-81dae94a3236 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:19.255212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:19.258660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:19.259448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:19.260170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] PATH_INFO: `/v3/projects/9d8d0d38cbca4a8e95281e756567439e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:19.262630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8d0d38cbca4a8e95281e756567439e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:19.266291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:19.373462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8d0d38cbca4a8e95281e756567439e', 'request_id': 'req-6a754450-23a4-4c3a-a478-ff68930fa6ac'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:19.387530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8d0d38cbca4a8e95281e756567439e', 'request_id': 'req-6a754450-23a4-4c3a-a478-ff68930fa6ac'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:19.407228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8d0d38cbca4a8e95281e756567439e', 'request_id': 'req-6a754450-23a4-4c3a-a478-ff68930fa6ac'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:19.436400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] The token cache is being invalidate because project 9d8d0d38cbca4a8e95281e756567439e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:19.436877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:19.437858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6a754450-23a4-4c3a-a478-ff68930fa6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:19.445227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bf7e-5331-40bd-99fa-bcda6b6407ac None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:19.445800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 673/1327] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:18 2022] DELETE /identity/v3/projects/9d8d0d38cbca4a8e95281e756567439e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:19.446280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bf7e-5331-40bd-99fa-bcda6b6407ac None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:19.446520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bf7e-5331-40bd-99fa-bcda6b6407ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:19.509323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b237bf7e-5331-40bd-99fa-bcda6b6407ac None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:19.512811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b237bf7e-5331-40bd-99fa-bcda6b6407ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:19.666319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 655/1328] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:19.676225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d95548-4bcf-4a1f-b81e-ba8027749a39 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:19.676704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d95548-4bcf-4a1f-b81e-ba8027749a39 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:19.677605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d95548-4bcf-4a1f-b81e-ba8027749a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:19.740423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-04d95548-4bcf-4a1f-b81e-ba8027749a39 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:19.746596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-04d95548-4bcf-4a1f-b81e-ba8027749a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:19.788850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 674/1329] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:19.789271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bf7e-5331-40bd-99fa-bcda6b6407ac None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:19.805599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bf7e-5331-40bd-99fa-bcda6b6407ac None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:19.835033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:19.836422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:19.836702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:19.836993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:19.837665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:19.837970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:19.841726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:19.876452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 656/1330] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:19.877912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d95548-4bcf-4a1f-b81e-ba8027749a39 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:19.897023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d95548-4bcf-4a1f-b81e-ba8027749a39 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:19.902494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:19.903133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:19.903576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:19.903859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:19.904508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:19.906579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:19.993699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 675/1331] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:19 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:19.996044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:20.012261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2aa5-3d56-4f1d-b49d-d495383d4378 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:20.199128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:20.199847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:20.200043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:20.200311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:20.201110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:20.205931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:20.304673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 657/1332] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:19 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:20.308158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:20.323063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7dd47-feca-4f43-9e02-68d696692d7d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:20.354564 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:20.357478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:20.359981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:20.367354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:20.370237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:20.373288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:20.409858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:20.416309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 676/1333] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:20.429132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebb457-d6a3-4f44-92a3-3e8a7b7b1ee6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:20.439949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:20.442993 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:20.454090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:20.457704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:20.460626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:20.464772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:20.468750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:20.470803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:20.491021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c882-35fa-4fe5-958d-306d43a29e45 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:20.506304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:20.506304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:20.506304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:20.506304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] PATH_INFO: `/v3/users/3026f421625345da9741ad2175b46fcf` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:20.507438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3026f421625345da9741ad2175b46fcf)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:20.509535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:20.510491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 658/1334] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:11:20.511449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:20.523449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0143b9-b9d9-45f5-98d5-586b0b63d687 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:20.532615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e0ec-ffd7-43c1-981b-c74b9a1fb845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:20.533871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e0ec-ffd7-43c1-981b-c74b9a1fb845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:20.534334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e0ec-ffd7-43c1-981b-c74b9a1fb845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:20.534808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e0ec-ffd7-43c1-981b-c74b9a1fb845 admin admin] PATH_INFO: `/v3/projects/9a0f22f7cc69402191d27b598d60738c/users/0eca56179f684794ba749faff1d0a868/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:20.569751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e0ec-ffd7-43c1-981b-c74b9a1fb845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0f22f7cc69402191d27b598d60738c, user_id=0eca56179f684794ba749faff1d0a868, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:20.576011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e0ec-ffd7-43c1-981b-c74b9a1fb845 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:20.583055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:20.613275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 659/1335] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:20 2022] PUT /identity/v3/projects/9a0f22f7cc69402191d27b598d60738c/users/0eca56179f684794ba749faff1d0a868/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:20.614143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3026f421625345da9741ad2175b46fcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:20.615482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:20.615944 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:20.616513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:20.629590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3026f421625345da9741ad2175b46fcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:20.632645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3026f421625345da9741ad2175b46fcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:20.633461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3026f421625345da9741ad2175b46fcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:20.661252 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7e17e2e-7634-4439-853f-3a7a3fef6734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3026f421625345da9741ad2175b46fcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:20.662343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:20.663731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:20.677631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:20.689765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 677/1336] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:20 2022] DELETE /identity/v3/users/3026f421625345da9741ad2175b46fcf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:20.694160 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:20.694755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:20.695266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:20.733562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:20.735048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:20.794381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 660/1337] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:20.870867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 678/1338] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:20.893483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:20.894935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:20.895858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:20.897156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:21.026415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f3cc4-bc0d-48ba-9736-284b8f6c471b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:21.144677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99fe9-be97-4b5d-92db-9cd63afa742a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:21.155398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f534-9840-4447-a4b0-7217156f3df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:21.156393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f534-9840-4447-a4b0-7217156f3df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:21.156819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f534-9840-4447-a4b0-7217156f3df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:21.157283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f534-9840-4447-a4b0-7217156f3df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:21.159116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:21.159976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:21.161084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:21.161520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:21.186171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375f534-9840-4447-a4b0-7217156f3df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:21.187634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375f534-9840-4447-a4b0-7217156f3df6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:21.188346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:21.196329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:21.210998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 661/1339] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:21.227071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 679/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:11:24.158525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:24.159828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:24.160326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:24.229532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] MFA Rules not processed for user `ab8ab12109f34f0ab1d13b1cf2d375d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:24.233358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:24.247167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:24.249550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:24.285954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb2dad-a3e9-40a3-8f95-d2e9f98b6dcd service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:24.298332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:24.299703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:24.300856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:24.301337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] PATH_INFO: `/v3/projects/07544aa0b7644737beaec8e1c0642440` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:24.303886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07544aa0b7644737beaec8e1c0642440)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:24.308303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:24.397638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 662/1341] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:24.405988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:24.416235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07544aa0b7644737beaec8e1c0642440', 'request_id': 'req-39d276b6-3f08-46bf-bda2-86d969458052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:24.436137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:24.439775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:24.440523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07544aa0b7644737beaec8e1c0642440', 'request_id': 'req-39d276b6-3f08-46bf-bda2-86d969458052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:24.448341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:24.451063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07544aa0b7644737beaec8e1c0642440', 'request_id': 'req-39d276b6-3f08-46bf-bda2-86d969458052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:24.480961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] The token cache is being invalidate because project 07544aa0b7644737beaec8e1c0642440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:24.482465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:24.485531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39d276b6-3f08-46bf-bda2-86d969458052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:24.490146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 680/1342] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:24 2022] DELETE /identity/v3/projects/07544aa0b7644737beaec8e1c0642440 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:24.495125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b8e25-0d90-4f0b-b720-db2046fe8af6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:24.495684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b8e25-0d90-4f0b-b720-db2046fe8af6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:24.496198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b8e25-0d90-4f0b-b720-db2046fe8af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:24.539531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a04b8e25-0d90-4f0b-b720-db2046fe8af6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:24.544002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a04b8e25-0d90-4f0b-b720-db2046fe8af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:24.681036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699201c-5abb-44b0-8cfe-d988753948a3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:24.684734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 681/1343] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:24.693224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00c865-291b-4467-81e5-45cbc9baf0a8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:24.693512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00c865-291b-4467-81e5-45cbc9baf0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:24.693776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00c865-291b-4467-81e5-45cbc9baf0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:24.757455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9e00c865-291b-4467-81e5-45cbc9baf0a8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:24.760851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9e00c865-291b-4467-81e5-45cbc9baf0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:24.781953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 682/1344] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:24.784309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00c865-291b-4467-81e5-45cbc9baf0a8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:24.809770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00c865-291b-4467-81e5-45cbc9baf0a8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:24.820469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:24.821046 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:24.821331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:24.822318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:24.824638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:24.824901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:24.826789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:24.865843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 683/1345] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:11:24.867768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:24.886660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:24.888241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:24.888862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:24.889325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:24.894951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:24.907558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806005a-efea-4078-887d-c5901468f1ec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:24.929013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5cdd7-9f16-4331-b760-be221918dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:24.930739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cdd7-9f16-4331-b760-be221918dc2d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:24.930882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cdd7-9f16-4331-b760-be221918dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:24.932242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cdd7-9f16-4331-b760-be221918dc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:24.932888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5cdd7-9f16-4331-b760-be221918dc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:24.934869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5cdd7-9f16-4331-b760-be221918dc2d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:25.035010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 684/1346] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:24 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:25.039335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8bd1e-2435-4862-8c7b-944a8a621a61 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.039646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8bd1e-2435-4862-8c7b-944a8a621a61 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.039924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8bd1e-2435-4862-8c7b-944a8a621a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.110257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:25.110257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:25.143136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4fb8bd1e-2435-4862-8c7b-944a8a621a61 None None] MFA Rules not processed for user `10e74aaba7cc4b038b5028a76e78feab`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:25.150571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4fb8bd1e-2435-4862-8c7b-944a8a621a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:25.150919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 663/1347] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:11:25.152455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:25.188065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2c3e-a5df-4ba7-926a-b59fda417b84 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:25.350924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:25.429610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 685/1348] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:25.437479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.440220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.441263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.461237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:25.462193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.462695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.463850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.477828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:25.480745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:25.545571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] MFA Rules not processed for user `10e74aaba7cc4b038b5028a76e78feab`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:25.548035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:25.571361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 686/1349] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:25.584099 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:25.586673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:25.599760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 664/1350] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:25 2022] POST /identity/v3/users => generated 284 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:25.602741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:25.624902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4784a4-248e-45f3-aed1-6851ad8340c8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:25.628176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:25.631274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:25.632040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.632275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.632535 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.633219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:25.635001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:25.654273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 665/1351] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:25.656580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:25.681729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59dccf-e84b-40dd-be34-813976b6339e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:25.692020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:25.693058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.693458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.695219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.695742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:25.698587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:25.719176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 666/1352] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:25.722132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:25.757214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e567d0-7a6a-4bc2-a29b-98a9792cf587 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:25.778960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ec39-1e3c-491a-8699-1cf407f4d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:25.781539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ec39-1e3c-491a-8699-1cf407f4d24e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.781835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ec39-1e3c-491a-8699-1cf407f4d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.782163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ec39-1e3c-491a-8699-1cf407f4d24e admin admin] PATH_INFO: `/v3/projects/a72aeeead05a4496a69efbe67f80eba5/users/f8f8fe7410fd485e9ce6c38541870f16/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.828228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ec39-1e3c-491a-8699-1cf407f4d24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72aeeead05a4496a69efbe67f80eba5, user_id=f8f8fe7410fd485e9ce6c38541870f16, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:25.833818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931ec39-1e3c-491a-8699-1cf407f4d24e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:25.836511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44bd60-18df-43ea-90e7-9ecf8f2c68f4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:25.854946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:25.855649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.855935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.856206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.880333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:25.880839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 667/1353] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:25 2022] PUT /identity/v3/projects/a72aeeead05a4496a69efbe67f80eba5/users/f8f8fe7410fd485e9ce6c38541870f16/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:25.882165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:25.893479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55632c-6107-4542-b4fa-c7d8158a25f0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:25.893702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55632c-6107-4542-b4fa-c7d8158a25f0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:25.893981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55632c-6107-4542-b4fa-c7d8158a25f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:25.908615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 687/1354] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:11:25.965258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7c55632c-6107-4542-b4fa-c7d8158a25f0 None None] MFA Rules not processed for user `f8f8fe7410fd485e9ce6c38541870f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:25.966820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7c55632c-6107-4542-b4fa-c7d8158a25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:26.146178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 668/1355] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:26.159348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:26.161897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:26.270886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd5ab7-f2f4-4f74-be12-dd43144d4cd7 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:26.396533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582a03e-64c0-4a07-bb89-1238eafdb3f2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:26.397132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582a03e-64c0-4a07-bb89-1238eafdb3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:26.397132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582a03e-64c0-4a07-bb89-1238eafdb3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:26.413456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:26.414097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:26.414374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:26.417082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:26.437369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:26.442623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:26.460794 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5582a03e-64c0-4a07-bb89-1238eafdb3f2 None None] MFA Rules not processed for user `0eca56179f684794ba749faff1d0a868`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:26.465168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5582a03e-64c0-4a07-bb89-1238eafdb3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:26.468582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 688/1356] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:26.645995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:26.667035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 669/1357] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:26 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:26.668555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:26.676327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:26.924682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:26.941973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459a98-31ac-4bc5-9930-721842e910ec service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:26.972870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:26.977721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:26.978046 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:26.978298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:26.981398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:26.983707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:27.092759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 689/1358] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:26 2022] POST /identity/v3/projects => generated 405 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:11:27.094109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582a03e-64c0-4a07-bb89-1238eafdb3f2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:27.116030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582a03e-64c0-4a07-bb89-1238eafdb3f2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:27.282322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:27.283810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:27.284911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:27.286996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:27.287728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:27.292563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:27.364175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 670/1359] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:27 2022] POST /identity/v3/users => generated 309 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:27.366541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:27.387504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6876d-dca5-4696-8c9a-88a23a0cf8ef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:27.412257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:27.413211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:27.413864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:27.414195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:27.415217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:27.421164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:27.456644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 690/1360] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:27.463038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:27.485788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc581a0-8008-4e65-b23c-86039e4edc2d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:27.508954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:27.509747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:27.510823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:27.512981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] PATH_INFO: `/v3/projects/2b628c5e3808447eb972eef3f2a31cb0/users/db5b4dab228c4cfd9d379b497dd50f74/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:27.587582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b628c5e3808447eb972eef3f2a31cb0, user_id=db5b4dab228c4cfd9d379b497dd50f74, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:27.590649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:27.618796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:27.624328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 671/1361] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:27 2022] PUT /identity/v3/projects/2b628c5e3808447eb972eef3f2a31cb0/users/db5b4dab228c4cfd9d379b497dd50f74/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:27.634790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc395e85-6952-4ad2-967c-ddd0b1eb018e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:27.798229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b714d-a065-4a25-aded-e527c56b023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:27.801024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b714d-a065-4a25-aded-e527c56b023a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:27.801024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b714d-a065-4a25-aded-e527c56b023a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:27.801024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b714d-a065-4a25-aded-e527c56b023a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:27.801024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b714d-a065-4a25-aded-e527c56b023a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:27.802622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b714d-a065-4a25-aded-e527c56b023a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:27.839111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:27.846696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 691/1362] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:27.850831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef567a4-9dfe-436f-8283-f31a9f44f347 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:27.859324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce12d1-ce35-4397-bcbd-91106d428b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:27.860018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce12d1-ce35-4397-bcbd-91106d428b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:27.860296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce12d1-ce35-4397-bcbd-91106d428b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:27.860566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce12d1-ce35-4397-bcbd-91106d428b00 admin admin] PATH_INFO: `/v3/projects/2b628c5e3808447eb972eef3f2a31cb0/users/db5b4dab228c4cfd9d379b497dd50f74/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:27.862758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce12d1-ce35-4397-bcbd-91106d428b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b628c5e3808447eb972eef3f2a31cb0, user_id=db5b4dab228c4cfd9d379b497dd50f74, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:27.865510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce12d1-ce35-4397-bcbd-91106d428b00 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:27.887100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 672/1363] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:27 2022] PUT /identity/v3/projects/2b628c5e3808447eb972eef3f2a31cb0/users/db5b4dab228c4cfd9d379b497dd50f74/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:28.110268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714027-ed1d-4cae-816f-97d118304679 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:28.110268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714027-ed1d-4cae-816f-97d118304679 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:28.110268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714027-ed1d-4cae-816f-97d118304679 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:28.110558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 692/1364] 10.222.0.25 () {54 vars in 912 bytes} [Sun Oct 23 02:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:28.124013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae05a-a904-4370-9eb1-eb72999bbc09 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:28.124013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae05a-a904-4370-9eb1-eb72999bbc09 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:28.124013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae05a-a904-4370-9eb1-eb72999bbc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:28.205315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f22ae05a-a904-4370-9eb1-eb72999bbc09 None None] MFA Rules not processed for user `1dc28ef7b36746208560692b17809e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:28.206666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f22ae05a-a904-4370-9eb1-eb72999bbc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:28.316787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 673/1365] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:11:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:28.362506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714027-ed1d-4cae-816f-97d118304679 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:28.371169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d6714027-ed1d-4cae-816f-97d118304679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:28.411537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714027-ed1d-4cae-816f-97d118304679 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:28.417321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:28.418620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:28.419228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:28.419780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:28.430045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:28.431818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:28.443875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 693/1366] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:28.908948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:28.910181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:28.910631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:29.025615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] MFA Rules not processed for user `be16189fa09d4c70b600601d941e31fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:29.044230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:29.195381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:29.301156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 674/1367] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:29.315694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:29.317282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:29.664132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62594be-91b9-42c4-a885-aa10523aecac service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:29.690417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f3726-b469-44ac-a905-aae133c3b55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:29.691214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3726-b469-44ac-a905-aae133c3b55d service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:29.691630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3726-b469-44ac-a905-aae133c3b55d service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:29.692020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3726-b469-44ac-a905-aae133c3b55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:29.716605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f3726-b469-44ac-a905-aae133c3b55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:29.718432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f3726-b469-44ac-a905-aae133c3b55d service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:29.812742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 694/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:30.470651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:30.475071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:30.661876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf4612-550a-47fc-aeb8-c2973c550451 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:30.683973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38625f41-0f84-4a30-8333-75913b09a08c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:30.684811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625f41-0f84-4a30-8333-75913b09a08c service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:30.685351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625f41-0f84-4a30-8333-75913b09a08c service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:30.685526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625f41-0f84-4a30-8333-75913b09a08c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:30.687386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-38625f41-0f84-4a30-8333-75913b09a08c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:30.711464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38625f41-0f84-4a30-8333-75913b09a08c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:30.713431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38625f41-0f84-4a30-8333-75913b09a08c service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:30.734440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 675/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:30.810905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0706-e003-4b80-ae11-491719f2e96e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:30.811545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0706-e003-4b80-ae11-491719f2e96e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:30.811545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0706-e003-4b80-ae11-491719f2e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:30.879704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b79d0706-e003-4b80-ae11-491719f2e96e None None] MFA Rules not processed for user `10e74aaba7cc4b038b5028a76e78feab`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:30.882187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b79d0706-e003-4b80-ae11-491719f2e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:30.967229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:31.012386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 695/1370] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:31.319423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b3bec-a7f5-43b6-98e5-4eb4f9cda6f3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:31.319909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b3bec-a7f5-43b6-98e5-4eb4f9cda6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:31.320563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b3bec-a7f5-43b6-98e5-4eb4f9cda6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:31.356565 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-791b3bec-a7f5-43b6-98e5-4eb4f9cda6f3 None None] MFA Rules not processed for user `ab8ab12109f34f0ab1d13b1cf2d375d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:31.357914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-791b3bec-a7f5-43b6-98e5-4eb4f9cda6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:31.484480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 676/1371] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:32.319955 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b0309-4836-4938-a9e3-bc1df2e88e78 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:32.320454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b0309-4836-4938-a9e3-bc1df2e88e78 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:32.320563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b0309-4836-4938-a9e3-bc1df2e88e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:32.388953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4f5b0309-4836-4938-a9e3-bc1df2e88e78 None None] MFA Rules not processed for user `db5b4dab228c4cfd9d379b497dd50f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:32.393576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4f5b0309-4836-4938-a9e3-bc1df2e88e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:32.569569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 696/1372] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:33.092762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f7a81-33fb-44dc-9418-b611e7f42bf0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:33.093326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f7a81-33fb-44dc-9418-b611e7f42bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:33.093582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f7a81-33fb-44dc-9418-b611e7f42bf0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:33.096316 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 677/1373] 10.222.0.25 () {54 vars in 912 bytes} [Sun Oct 23 02:11:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:33.111982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:33.112552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:33.113079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:33.156061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] MFA Rules not processed for user `1dc28ef7b36746208560692b17809e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:33.161334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:33.181862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175474e9-d085-4d0a-8c2c-03d7e19e6157 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:33.189936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175474e9-d085-4d0a-8c2c-03d7e19e6157 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:33.190289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175474e9-d085-4d0a-8c2c-03d7e19e6157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:33.195113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 697/1374] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:11:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:33.259794 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-175474e9-d085-4d0a-8c2c-03d7e19e6157 None None] MFA Rules not processed for user `3b1d073ea32449458376dea2ab919a48`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:33.268834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-175474e9-d085-4d0a-8c2c-03d7e19e6157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:33.386979 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:33.388947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:33.404883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea201222-3a0d-44f7-88a3-10b789ace07d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:33.408937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:33.409610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:33.409890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:33.410160 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:33.422640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:33.427005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:33.482734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 698/1375] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:33.609065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 678/1376] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:33.837549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:33.868449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d5b9-46c2-4882-b260-0aea959c056d service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:33.887804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a734787-cd66-40a1-961b-3bcfc6868d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:33.888655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a734787-cd66-40a1-961b-3bcfc6868d3b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:33.889163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a734787-cd66-40a1-961b-3bcfc6868d3b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:33.889589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a734787-cd66-40a1-961b-3bcfc6868d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:33.913719 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a734787-cd66-40a1-961b-3bcfc6868d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:33.921218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a734787-cd66-40a1-961b-3bcfc6868d3b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:33.955571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 699/1377] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:34.003536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347abb8-e356-48ca-92a9-4958981c04cd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:34.004014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347abb8-e356-48ca-92a9-4958981c04cd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:34.005019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347abb8-e356-48ca-92a9-4958981c04cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:34.013317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:34.088307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8347abb8-e356-48ca-92a9-4958981c04cd None None] MFA Rules not processed for user `0037e6edc2b440b887597aa419540efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:34.089642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8347abb8-e356-48ca-92a9-4958981c04cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:34.238911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 679/1378] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:34.240470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a5db1-65dc-44d1-9909-e8918aaf27bc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:34.240756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a5db1-65dc-44d1-9909-e8918aaf27bc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:34.241070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a5db1-65dc-44d1-9909-e8918aaf27bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:34.272730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-390a5db1-65dc-44d1-9909-e8918aaf27bc None None] MFA Rules not processed for user `0037e6edc2b440b887597aa419540efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:34.275291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-390a5db1-65dc-44d1-9909-e8918aaf27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:34.294894 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 700/1379] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:34.315523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347abb8-e356-48ca-92a9-4958981c04cd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:34.345665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347abb8-e356-48ca-92a9-4958981c04cd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:34.371797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a02c8-f8a2-444d-90cd-48a849a5298a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:34.374441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a02c8-f8a2-444d-90cd-48a849a5298a service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:34.374860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a02c8-f8a2-444d-90cd-48a849a5298a service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:34.375247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a02c8-f8a2-444d-90cd-48a849a5298a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:34.398919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a02c8-f8a2-444d-90cd-48a849a5298a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:34.409852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a02c8-f8a2-444d-90cd-48a849a5298a service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:34.446502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 680/1380] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:11:34.919259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce96597-689a-47a5-aebe-269af87c9056 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:34.919805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce96597-689a-47a5-aebe-269af87c9056 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:34.919805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce96597-689a-47a5-aebe-269af87c9056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:35.029055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7ce96597-689a-47a5-aebe-269af87c9056 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:35.033651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7ce96597-689a-47a5-aebe-269af87c9056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:35.222010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4297c-d0da-438b-9f62-d8563f9ab691 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:35.222294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4297c-d0da-438b-9f62-d8563f9ab691 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:35.222564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4297c-d0da-438b-9f62-d8563f9ab691 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:35.224059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 681/1381] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 02:11:35.250085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5b4cb-a876-43b2-9582-fcafba253541 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:35.252693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5b4cb-a876-43b2-9582-fcafba253541 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:35.253162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5b4cb-a876-43b2-9582-fcafba253541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:35.256617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 701/1382] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:11:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:35.300515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-28b5b4cb-a876-43b2-9582-fcafba253541 None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:35.301626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-28b5b4cb-a876-43b2-9582-fcafba253541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:35.320924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 682/1383] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:35.339373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22325ee-8fe1-4025-9a93-6d53ba9491d2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:35.340401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22325ee-8fe1-4025-9a93-6d53ba9491d2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:35.340923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22325ee-8fe1-4025-9a93-6d53ba9491d2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:35.344174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 702/1384] 10.222.0.25 () {54 vars in 961 bytes} [Sun Oct 23 02:11:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:35.356025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:35.357834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:35.358339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:35.391204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:35.392769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:35.404154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 683/1385] 10.222.0.25 () {58 vars in 1058 bytes} [Sun Oct 23 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:35.413997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22325ee-8fe1-4025-9a93-6d53ba9491d2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:35.423473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:35.446272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22325ee-8fe1-4025-9a93-6d53ba9491d2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:35.462285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b7c7-2e54-4fd4-8711-7fbaea5834c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:35.464627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b7c7-2e54-4fd4-8711-7fbaea5834c2 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:35.465106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b7c7-2e54-4fd4-8711-7fbaea5834c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:35.466790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b7c7-2e54-4fd4-8711-7fbaea5834c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:35.490063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4b7c7-2e54-4fd4-8711-7fbaea5834c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:35.493391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4b7c7-2e54-4fd4-8711-7fbaea5834c2 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:35.526045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 703/1386] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:35.544806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:35.546313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:35.754269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c99d1-2c85-408d-a168-27ea2214db8d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:35.774600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c190f-2e88-4b08-b7c8-709fd7ace550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:35.775253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c190f-2e88-4b08-b7c8-709fd7ace550 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:35.775551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c190f-2e88-4b08-b7c8-709fd7ace550 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:35.775822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c190f-2e88-4b08-b7c8-709fd7ace550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:35.799135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c190f-2e88-4b08-b7c8-709fd7ace550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:35.803390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c190f-2e88-4b08-b7c8-709fd7ace550 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:35.824752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 684/1387] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:11:38.995280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec414342-8bc1-4715-9755-67b721f48c10 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:38.997022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec414342-8bc1-4715-9755-67b721f48c10 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:38.997765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec414342-8bc1-4715-9755-67b721f48c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:39.037516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ec414342-8bc1-4715-9755-67b721f48c10 None None] MFA Rules not processed for user `be16189fa09d4c70b600601d941e31fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:39.039100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ec414342-8bc1-4715-9755-67b721f48c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:39.072941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 704/1388] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:39.388789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df089-842e-4f04-9ace-f80a9c05d4e6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:39.389494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df089-842e-4f04-9ace-f80a9c05d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:39.389494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df089-842e-4f04-9ace-f80a9c05d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:39.434391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-103df089-842e-4f04-9ace-f80a9c05d4e6 None None] MFA Rules not processed for user `1dc28ef7b36746208560692b17809e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:39.438093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-103df089-842e-4f04-9ace-f80a9c05d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:39.458372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 685/1389] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Oct 23 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:39.481192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec414342-8bc1-4715-9755-67b721f48c10 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:39.513306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec414342-8bc1-4715-9755-67b721f48c10 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:39.527077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:39.528179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:39.529982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:39.530450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:39.567833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:39.574527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:39.600668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 705/1390] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:40.127881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103df089-842e-4f04-9ace-f80a9c05d4e6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:40.212173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:40.300202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103df089-842e-4f04-9ace-f80a9c05d4e6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:40.334633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:40.337545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:40.337826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:40.338860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] PATH_INFO: `/v3/users/0eca56179f684794ba749faff1d0a868` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:40.343414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eca56179f684794ba749faff1d0a868)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:40.349659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:40.503898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eca56179f684794ba749faff1d0a868'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:40.504848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eca56179f684794ba749faff1d0a868'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:40.517592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eca56179f684794ba749faff1d0a868'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:40.518875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eca56179f684794ba749faff1d0a868'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:40.587900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eca56179f684794ba749faff1d0a868'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:40.627479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 686/1391] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:40 2022] DELETE /identity/v3/users/0eca56179f684794ba749faff1d0a868 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:41.577294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:41.599282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72068e73-3dbe-4bb3-9bb3-87e19c2b5945 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:41.840050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:41.840728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:41.841033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:41.841368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] PATH_INFO: `/v3/projects/9a0f22f7cc69402191d27b598d60738c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:41.843741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0f22f7cc69402191d27b598d60738c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:41.849394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:42.093779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0f22f7cc69402191d27b598d60738c', 'request_id': 'req-35b39015-85d2-416e-bd4e-a0241838e1e3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.120430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0f22f7cc69402191d27b598d60738c', 'request_id': 'req-35b39015-85d2-416e-bd4e-a0241838e1e3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.149368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0f22f7cc69402191d27b598d60738c', 'request_id': 'req-35b39015-85d2-416e-bd4e-a0241838e1e3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.202740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] The token cache is being invalidate because project 9a0f22f7cc69402191d27b598d60738c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:42.203171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.204356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-35b39015-85d2-416e-bd4e-a0241838e1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.208281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 706/1392] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:41 2022] DELETE /identity/v3/projects/9a0f22f7cc69402191d27b598d60738c => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:42.212417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:42.219017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:42.273268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0fb3-6657-48e0-9a6f-c4efb6f11db3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:42.459597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:42.460747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:42.461350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:42.461976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] PATH_INFO: `/v3/users/db5b4dab228c4cfd9d379b497dd50f74` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:42.465917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5b4dab228c4cfd9d379b497dd50f74)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:42.486788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:42.593297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5b4dab228c4cfd9d379b497dd50f74'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.602200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5b4dab228c4cfd9d379b497dd50f74'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.612787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:42.628416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5b4dab228c4cfd9d379b497dd50f74'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.629819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5b4dab228c4cfd9d379b497dd50f74'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.659373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1e76d77a-54d5-4a72-928e-8eede43727b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5b4dab228c4cfd9d379b497dd50f74'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:42.694939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 687/1393] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:42 2022] DELETE /identity/v3/users/db5b4dab228c4cfd9d379b497dd50f74 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:44.067049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037507d6-a1f4-45b5-a2d3-e72aba9a8393 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:44.067049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037507d6-a1f4-45b5-a2d3-e72aba9a8393 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:44.068229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037507d6-a1f4-45b5-a2d3-e72aba9a8393 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:44.069441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 707/1394] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:44.326309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:44.327187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:44.327824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:44.366791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:44.368592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:44.550498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 688/1395] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:11:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:45.070658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037507d6-a1f4-45b5-a2d3-e72aba9a8393 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:45.073174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-037507d6-a1f4-45b5-a2d3-e72aba9a8393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:45.120156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037507d6-a1f4-45b5-a2d3-e72aba9a8393 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:45.134633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fe310-9407-4758-b735-71a8ad654786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:45.135352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe310-9407-4758-b735-71a8ad654786 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:45.135632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe310-9407-4758-b735-71a8ad654786 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:45.135942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe310-9407-4758-b735-71a8ad654786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:45.169339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fe310-9407-4758-b735-71a8ad654786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:45.170978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fe310-9407-4758-b735-71a8ad654786 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:45.213420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 708/1396] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:45.425107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:45.427406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:45.717049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:45.717562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:45.717980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:45.769617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc8fae-cd42-4122-9d0f-26717a90a470 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:45.793408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:45.802031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:45.802391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:45.802716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] PATH_INFO: `/v3/projects/2b628c5e3808447eb972eef3f2a31cb0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:45.804127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] MFA Rules not processed for user `3b1d073ea32449458376dea2ab919a48`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:45.808817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:45.811622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b628c5e3808447eb972eef3f2a31cb0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:45.813138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 02:11:45.813138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 23 02:11:45.813138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: Oct 23 02:11:45.826949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:46.067098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:46.117827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b628c5e3808447eb972eef3f2a31cb0', 'request_id': 'req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.150696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b628c5e3808447eb972eef3f2a31cb0', 'request_id': 'req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.153739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 709/1397] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:46.158977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:46.162652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:46.163632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:46.181450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b628c5e3808447eb972eef3f2a31cb0', 'request_id': 'req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.236067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca4db-c7f1-4ee8-9120-50f552d40f76 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:46.275978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] The token cache is being invalidate because project 2b628c5e3808447eb972eef3f2a31cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:46.276278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.281492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f3ed2322-ffce-4eaf-a550-3208d9a56ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.290590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 689/1398] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:45 2022] DELETE /identity/v3/projects/2b628c5e3808447eb972eef3f2a31cb0 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:46.300428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5688-0446-4bb9-97f5-5df724143e86 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:46.300727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5688-0446-4bb9-97f5-5df724143e86 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:46.303915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5688-0446-4bb9-97f5-5df724143e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:46.434560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-147f5688-0446-4bb9-97f5-5df724143e86 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:46.435836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-147f5688-0446-4bb9-97f5-5df724143e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:46.636700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:46.639343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:46.642016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:46.642626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] PATH_INFO: `/v3/users/f8f8fe7410fd485e9ce6c38541870f16` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:46.649199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f8fe7410fd485e9ce6c38541870f16)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:46.660899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:46.695004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 690/1399] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:46.696578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b2a9-23de-4687-a028-5803f851bc4f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:46.701359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b2a9-23de-4687-a028-5803f851bc4f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:46.701936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b2a9-23de-4687-a028-5803f851bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:46.757992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8170b2a9-23de-4687-a028-5803f851bc4f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:46.761447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8170b2a9-23de-4687-a028-5803f851bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:46.785270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 691/1400] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:46.789990 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170b2a9-23de-4687-a028-5803f851bc4f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:46.818577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170b2a9-23de-4687-a028-5803f851bc4f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:46.848500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f8fe7410fd485e9ce6c38541870f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.862636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:46.865511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:46.865848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:46.868687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:46.871721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:46.873642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:46.881827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:46.887840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f8fe7410fd485e9ce6c38541870f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.888937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f8fe7410fd485e9ce6c38541870f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.895530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f8fe7410fd485e9ce6c38541870f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.922599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 692/1401] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:46.924188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:46.931989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:46.936214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-16de2e80-4959-45a4-8143-d3f61628a4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f8fe7410fd485e9ce6c38541870f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:46.982493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 710/1402] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:46 2022] DELETE /identity/v3/users/f8f8fe7410fd485e9ce6c38541870f16 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:46.987907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0e2ac-f145-4765-b7bc-cf99763f6753 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:46.988245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0e2ac-f145-4765-b7bc-cf99763f6753 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:46.988533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0e2ac-f145-4765-b7bc-cf99763f6753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:46.990137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74c54-25d9-41f5-adee-47d1845b01d8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:47.061394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-17b0e2ac-f145-4765-b7bc-cf99763f6753 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:47.063844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17b0e2ac-f145-4765-b7bc-cf99763f6753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:47.239497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:47.240269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:47.240542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:47.240916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:47.241709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:47.243668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:47.303997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 693/1403] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:46 2022] POST /identity/v3/projects => generated 365 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:47.310270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:47.357510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 711/1404] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:47.443374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:47.456492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62dbda-bf60-4f49-8fe1-4fc9790620bd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:47.479111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:47.479894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:47.480052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:47.480261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:47.480892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:47.482979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:47.541370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 694/1405] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:47 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:11:47.543282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0e2ac-f145-4765-b7bc-cf99763f6753 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:47.567671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0e2ac-f145-4765-b7bc-cf99763f6753 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:47.589823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:47.590628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:47.591574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:47.591952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:47.592901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:47.600853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:47.620504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:47.621223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:47.623490 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:47.648098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 712/1406] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:47.655733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:47.687337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d312bc-a98a-4395-9233-5dc0cc6e2130 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:47.700056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:47.700865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:47.701282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:47.701700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:47.702599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:47.704641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:47.738043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 713/1407] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:47.742361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:47.762936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31584a11-30b0-4419-9b3d-a591489ff234 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:47.782535 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5da7-57a6-488a-b6a2-3cc9aa734807 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:47.790553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f83f63-fd92-4d69-aa68-8c98d128bd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:47.791339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83f63-fd92-4d69-aa68-8c98d128bd8c service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:47.791717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83f63-fd92-4d69-aa68-8c98d128bd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:47.791844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83f63-fd92-4d69-aa68-8c98d128bd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:47.793511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:47.794327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:47.794716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:47.795094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] PATH_INFO: `/v3/projects/25d9bb666f3a479f96df7bbe97774657/users/e118f608e1be41c7aea7a920f1bc1cca/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:47.820486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f83f63-fd92-4d69-aa68-8c98d128bd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:47.821997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f83f63-fd92-4d69-aa68-8c98d128bd8c service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:47.840251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d9bb666f3a479f96df7bbe97774657, user_id=e118f608e1be41c7aea7a920f1bc1cca, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:47.843313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:47.855008 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 695/1408] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:47.896865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 714/1409] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:47 2022] PUT /identity/v3/projects/25d9bb666f3a479f96df7bbe97774657/users/e118f608e1be41c7aea7a920f1bc1cca/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:47.907220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb473f-b2eb-4c47-ae47-8d1bae933e7b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:47.907477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb473f-b2eb-4c47-ae47-8d1bae933e7b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:47.907902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb473f-b2eb-4c47-ae47-8d1bae933e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:47.983747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-67eb473f-b2eb-4c47-ae47-8d1bae933e7b None None] MFA Rules not processed for user `e118f608e1be41c7aea7a920f1bc1cca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:47.984997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-67eb473f-b2eb-4c47-ae47-8d1bae933e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:48.300396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 696/1410] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:48.309510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:48.578396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09c556-8e39-47d6-99ba-68259ec5acc5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:48.604713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:48.605517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:48.605859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:48.606145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:48.607217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:48.610188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:48.735869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 715/1411] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:48 2022] POST /identity/v3/projects => generated 365 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:48.736109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb473f-b2eb-4c47-ae47-8d1bae933e7b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:48.753938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb473f-b2eb-4c47-ae47-8d1bae933e7b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:48.939936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:48.940823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:48.941322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:48.941783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:48.942791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:48.945865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:48.981315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 697/1412] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:48 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:11:48.986039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:49.003381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58709a7-8d94-4174-b661-4700f41a686c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:49.024330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:49.025138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:49.027046 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:49.027328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:49.028121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:49.029691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:49.082170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 716/1413] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:11:49.083371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:49.100034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe655f3f-6b42-41a1-859d-29959e4ed080 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:49.115084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:49.115840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:49.116123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:49.116425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] PATH_INFO: `/v3/projects/822abce2cf2b4853ade87de09e0eb091/users/c392daba968241b2b7bb4dd52b50ef5a/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:49.135333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:49.171552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822abce2cf2b4853ade87de09e0eb091, user_id=c392daba968241b2b7bb4dd52b50ef5a, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:49.177098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:49.245912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 698/1414] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:49 2022] PUT /identity/v3/projects/822abce2cf2b4853ade87de09e0eb091/users/c392daba968241b2b7bb4dd52b50ef5a/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:11:49.250009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:49.363776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee29aa-0bba-415e-9f47-8d51888ae32d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:49.530353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83fbd-5f1d-4b7a-aad3-6cacfbfaea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:49.530913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83fbd-5f1d-4b7a-aad3-6cacfbfaea2d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:49.531207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83fbd-5f1d-4b7a-aad3-6cacfbfaea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:49.531460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83fbd-5f1d-4b7a-aad3-6cacfbfaea2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:49.536793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83fbd-5f1d-4b7a-aad3-6cacfbfaea2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:49.538612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83fbd-5f1d-4b7a-aad3-6cacfbfaea2d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:49.571649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 717/1415] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:49.574549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:49.589833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746955cb-fb4c-4ecb-b3fb-dc1d3eb62127 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:49.611556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:49.612250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:49.612665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:49.612786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] PATH_INFO: `/v3/projects/822abce2cf2b4853ade87de09e0eb091/users/c392daba968241b2b7bb4dd52b50ef5a/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:49.620270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822abce2cf2b4853ade87de09e0eb091, user_id=c392daba968241b2b7bb4dd52b50ef5a, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:49.623021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:49.657309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 699/1416] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:49 2022] PUT /identity/v3/projects/822abce2cf2b4853ade87de09e0eb091/users/c392daba968241b2b7bb4dd52b50ef5a/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:49.669747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91adc2b-a448-4983-b071-7b3547ff1892 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:49.670323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91adc2b-a448-4983-b071-7b3547ff1892 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:49.670323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91adc2b-a448-4983-b071-7b3547ff1892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:49.755569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e91adc2b-a448-4983-b071-7b3547ff1892 None None] MFA Rules not processed for user `c392daba968241b2b7bb4dd52b50ef5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:49.762547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e91adc2b-a448-4983-b071-7b3547ff1892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:49.825107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:49.951670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 718/1417] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:49.961203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:49.967170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:50.135907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d51da6-a4cf-4423-b32f-53bab00d5cc8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:50.145089 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:50.145484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:50.146280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:50.146280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:50.168425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:50.171475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:50.214177 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 700/1418] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:51.173542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340ebca-b60d-4cb3-a68e-061541a2f85d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:51.174173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340ebca-b60d-4cb3-a68e-061541a2f85d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:51.174491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340ebca-b60d-4cb3-a68e-061541a2f85d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:51.177166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 719/1419] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:11:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:51.194684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:51.200431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50f72-7abe-4fc4-87b3-c01d473a81cc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:51.200902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50f72-7abe-4fc4-87b3-c01d473a81cc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:51.201376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50f72-7abe-4fc4-87b3-c01d473a81cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:51.243288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7df50f72-7abe-4fc4-87b3-c01d473a81cc None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:51.246628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7df50f72-7abe-4fc4-87b3-c01d473a81cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:51.357273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159df80-bb8f-4abc-863f-03443c3726b2 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:51.369766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:51.371133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:51.371421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:51.375068 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] PATH_INFO: `/v3/users/e118f608e1be41c7aea7a920f1bc1cca` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:51.379891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e118f608e1be41c7aea7a920f1bc1cca)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:51.382069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:51.491557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 720/1420] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:51.493815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e118f608e1be41c7aea7a920f1bc1cca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:51.494520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e118f608e1be41c7aea7a920f1bc1cca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:51.511261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e118f608e1be41c7aea7a920f1bc1cca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:51.512551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e118f608e1be41c7aea7a920f1bc1cca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:51.555340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e118f608e1be41c7aea7a920f1bc1cca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:51.562719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:51.598236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 701/1421] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:51 2022] DELETE /identity/v3/users/e118f608e1be41c7aea7a920f1bc1cca => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:51.603659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:51.604170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:51.604684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:51.662849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:51.664062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:51.852124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 721/1422] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:51.901834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:51.905681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:51.914129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:51.915671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:51.953581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d032a-6450-45ba-8968-dcd0f58fa0a6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:51.959817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:51.960549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:51.960844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:51.961162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] PATH_INFO: `/v3/projects/a72aeeead05a4496a69efbe67f80eba5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:51.963242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72aeeead05a4496a69efbe67f80eba5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:51.965546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:52.073542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:52.078440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72aeeead05a4496a69efbe67f80eba5', 'request_id': 'req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:52.097661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72aeeead05a4496a69efbe67f80eba5', 'request_id': 'req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:52.112793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72aeeead05a4496a69efbe67f80eba5', 'request_id': 'req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:52.142976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] The token cache is being invalidate because project a72aeeead05a4496a69efbe67f80eba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:52.144454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:52.147543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee10c5b1-3b3b-4dfb-b1c0-4be542b2d939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:52.163478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 722/1423] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:51 2022] DELETE /identity/v3/projects/a72aeeead05a4496a69efbe67f80eba5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:52.170670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:52.171500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:52.171500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:52.172364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d945f0-e728-4090-8dc9-8b8dd16ab3b5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:52.212538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:52.215626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:52.303202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7eb18-18cb-40b1-a4ab-282097adfa10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:52.306780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7eb18-18cb-40b1-a4ab-282097adfa10 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:52.307070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7eb18-18cb-40b1-a4ab-282097adfa10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:52.307364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7eb18-18cb-40b1-a4ab-282097adfa10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:52.318258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5ba7eb18-18cb-40b1-a4ab-282097adfa10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:52.369942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 723/1424] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:52.370967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:52.372496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:52.523935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7eb18-18cb-40b1-a4ab-282097adfa10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:52.526715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7eb18-18cb-40b1-a4ab-282097adfa10 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:52.550239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 702/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:52.554719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664116c5-6a8e-46f1-8056-3c7b8625e220 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:52.555116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664116c5-6a8e-46f1-8056-3c7b8625e220 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:52.555279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664116c5-6a8e-46f1-8056-3c7b8625e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:52.606194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1b60-c0ea-4add-9b81-f26d72e23999 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:52.615219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-664116c5-6a8e-46f1-8056-3c7b8625e220 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:52.616633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-664116c5-6a8e-46f1-8056-3c7b8625e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:52.621968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:52.622707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:52.622890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:52.623157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:52.627071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:52.637154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 703/1426] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:52.642273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664116c5-6a8e-46f1-8056-3c7b8625e220 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:52.659966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:52.660251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664116c5-6a8e-46f1-8056-3c7b8625e220 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:52.662112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:52.673920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:52.674381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:52.674720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:52.674993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:52.675792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:52.677247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:52.681359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:52.692427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 724/1427] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:52.727206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 704/1428] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:52.733740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:52.769649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c5438-80c4-4389-aee9-db590443b5a6 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:52.784452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:52.785144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:52.785404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:52.788509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:52.789276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:52.791620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:52.836507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 725/1429] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:52 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:52.841686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:52.853358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea535e-8522-4b10-b87d-126b33798eca admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:52.938703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:53.003034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:53.004519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:53.006952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:53.007507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:53.008648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:53.011298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:53.073923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 705/1430] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:52 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:53.078094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:53.094261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21606607-da9b-4a15-bef0-d8efe4ae9117 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:53.102147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:53.103055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:53.103350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:53.103704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:53.104275 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:53.106465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:53.131992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 726/1431] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:11:53.133419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:53.147686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba703c6-97de-4747-90af-cb07fe24c04d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:53.157822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fbc00-e3a6-4007-8f43-212e2a2a2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:53.161624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fbc00-e3a6-4007-8f43-212e2a2a2d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:53.161974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fbc00-e3a6-4007-8f43-212e2a2a2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:53.162251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fbc00-e3a6-4007-8f43-212e2a2a2d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:53.165282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fbc00-e3a6-4007-8f43-212e2a2a2d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:53.170553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fbc00-e3a6-4007-8f43-212e2a2a2d47 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:53.195125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 706/1432] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:53.199470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:53.229537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8fcc-39c0-4f08-ac96-eb409b72afa0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:53.237035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:53.237924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:53.238282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:53.238658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] PATH_INFO: `/v3/projects/df47d0d136df4c76a07d59d4489a98ac/users/9152a02c12c046d6a9bb5943be68317f/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:53.276823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df47d0d136df4c76a07d59d4489a98ac, user_id=9152a02c12c046d6a9bb5943be68317f, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:53.285681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:53.319609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd559d-13cd-417b-bce5-3d8a23dfd362 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:53.320069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd559d-13cd-417b-bce5-3d8a23dfd362 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:53.320154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd559d-13cd-417b-bce5-3d8a23dfd362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:53.333103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 727/1433] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:53 2022] PUT /identity/v3/projects/df47d0d136df4c76a07d59d4489a98ac/users/9152a02c12c046d6a9bb5943be68317f/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:53.395731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2dcd559d-13cd-417b-bce5-3d8a23dfd362 None None] MFA Rules not processed for user `9152a02c12c046d6a9bb5943be68317f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:53.397087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2dcd559d-13cd-417b-bce5-3d8a23dfd362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:53.686824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 707/1434] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:53.691855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:53.699786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:53.844124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37426-cc13-4d45-bcfb-869cc321f011 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:53.872041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:53.873263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:53.873930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:53.874421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:53.875583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:53.882043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:53.929662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 728/1435] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:53 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:53.931162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd559d-13cd-417b-bce5-3d8a23dfd362 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:53.947138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd559d-13cd-417b-bce5-3d8a23dfd362 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.056864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.058981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:54.180686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.181399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.181682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.182215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.182830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.187517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.264049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 708/1436] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:53 2022] POST /identity/v3/users => generated 297 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:54.268808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.283407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2a87-1cc6-4b77-8fab-0e1c201e61a2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.289592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.290895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.291183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.291460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.292383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.294350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.311674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 709/1437] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:54.315937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.321169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710e75f-cc76-429e-a81d-1a951a909554 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.334967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.340009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.340009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.340009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] PATH_INFO: `/v3/projects/25d9bb666f3a479f96df7bbe97774657` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.340217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b0da9-35ec-4cf6-a9fa-fb3623e7a553 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.340864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d9bb666f3a479f96df7bbe97774657)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.346390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.360438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.363616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.365460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.365998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] PATH_INFO: `/v3/projects/fdb18ad933c34b418b9472e51cab1cd1/users/54b2aeee0c554ed9abdd85954ec8f6b8/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.402435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb18ad933c34b418b9472e51cab1cd1, user_id=54b2aeee0c554ed9abdd85954ec8f6b8, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.405329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.420803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:54.437269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 710/1438] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:54 2022] PUT /identity/v3/projects/fdb18ad933c34b418b9472e51cab1cd1/users/54b2aeee0c554ed9abdd85954ec8f6b8/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:54.437269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.439469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:54.492790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d9bb666f3a479f96df7bbe97774657', 'request_id': 'req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.508216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d9bb666f3a479f96df7bbe97774657', 'request_id': 'req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.523537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d9bb666f3a479f96df7bbe97774657', 'request_id': 'req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.550600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] The token cache is being invalidate because project 25d9bb666f3a479f96df7bbe97774657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:54.550930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.552236 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.559103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 729/1439] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:54 2022] DELETE /identity/v3/projects/25d9bb666f3a479f96df7bbe97774657 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:54.560390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.562610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:54.589452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930cd3-4f73-4de0-9438-35a9f8ae91cd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.601739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:54.662855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b47a1-ecfe-4905-bd0a-8ec83c3c9521 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.668268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.671484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.672120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.672398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.672724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] PATH_INFO: `/v3/users/233fb55c171f44ea955ba2f5ac67858f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.674086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.674391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.674658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] RBAC: Authorizing `identity:delete_user(user_id=233fb55c171f44ea955ba2f5ac67858f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.674758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.675338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.676559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.676958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.689528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 730/1440] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:54.690759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.693090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:54.710129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761359f0-901e-457a-86bb-6fdf12520c4f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.715731 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.716450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.716805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.717208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] PATH_INFO: `/v3/users/c392daba968241b2b7bb4dd52b50ef5a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.718430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c392daba968241b2b7bb4dd52b50ef5a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.721023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.726029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233fb55c171f44ea955ba2f5ac67858f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.726698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233fb55c171f44ea955ba2f5ac67858f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.734671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233fb55c171f44ea955ba2f5ac67858f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.736307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233fb55c171f44ea955ba2f5ac67858f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.749538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233fb55c171f44ea955ba2f5ac67858f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.762429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 711/1441] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:54 2022] DELETE /identity/v3/users/233fb55c171f44ea955ba2f5ac67858f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:54.763194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.764489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:54.772247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c392daba968241b2b7bb4dd52b50ef5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.779475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c392daba968241b2b7bb4dd52b50ef5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.780190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c392daba968241b2b7bb4dd52b50ef5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.780822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c392daba968241b2b7bb4dd52b50ef5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.794642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cd548e37-ab4b-4f31-b792-14971c171963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c392daba968241b2b7bb4dd52b50ef5a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:54.796124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:54.807901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 731/1442] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:54 2022] DELETE /identity/v3/users/c392daba968241b2b7bb4dd52b50ef5a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:54.809265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.809553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.809831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.832135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:54.833583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:54.840112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e934d-8b2a-4412-9a8d-d0e837eeeaac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:54.907856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 732/1443] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:54.915991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b9e61-e5d1-48f1-b806-15b498e9c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:54.916775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9e61-e5d1-48f1-b806-15b498e9c3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.917088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9e61-e5d1-48f1-b806-15b498e9c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.917363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9e61-e5d1-48f1-b806-15b498e9c3b9 admin admin] PATH_INFO: `/v3/projects/fdb18ad933c34b418b9472e51cab1cd1/users/54b2aeee0c554ed9abdd85954ec8f6b8/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.918449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:54.919581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b9e61-e5d1-48f1-b806-15b498e9c3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb18ad933c34b418b9472e51cab1cd1, user_id=54b2aeee0c554ed9abdd85954ec8f6b8, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:54.921069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:54.922933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b9e61-e5d1-48f1-b806-15b498e9c3b9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:54.940094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 712/1444] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:54 2022] PUT /identity/v3/projects/fdb18ad933c34b418b9472e51cab1cd1/users/54b2aeee0c554ed9abdd85954ec8f6b8/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:54.950566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:54.950852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:54.951122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:54.967767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:54.989844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] MFA Rules not processed for user `54b2aeee0c554ed9abdd85954ec8f6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:54.991320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:55.004292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843ec1-036c-43ab-a8a8-40ed90831370 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:55.068420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:55.069213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:55.069767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:55.070272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:55.101016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 713/1445] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:55.118650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:55.120232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:55.212546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:55.215076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:55.241707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 733/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:11:55.244398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488cace-769d-4491-809f-0d6057b7b08a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:55.248492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:55.249242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:55.249616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:55.249959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:55.257582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:55.260909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:55.263110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:55.280201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 714/1447] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:11:55.418237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:55.433167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e475cc4-8e58-4f59-95d7-992bb9ca58a9 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:55.439411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995b5a6-ff0d-4aba-839d-eea879b2ace9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:55.440460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b5a6-ff0d-4aba-839d-eea879b2ace9 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:55.441630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b5a6-ff0d-4aba-839d-eea879b2ace9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:55.441960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b5a6-ff0d-4aba-839d-eea879b2ace9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:55.444419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5995b5a6-ff0d-4aba-839d-eea879b2ace9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:55.548025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995b5a6-ff0d-4aba-839d-eea879b2ace9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:55.551847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995b5a6-ff0d-4aba-839d-eea879b2ace9 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:55.570271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 734/1448] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:56.387567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:56.389225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:56.419194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420f5d2-4a45-45e5-add1-e7a5e0c19ab6 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:56.429866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:56.430984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:56.431277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:56.431537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] PATH_INFO: `/v3/projects/822abce2cf2b4853ade87de09e0eb091` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:56.433647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=822abce2cf2b4853ade87de09e0eb091)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:56.435804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:56.493299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822abce2cf2b4853ade87de09e0eb091', 'request_id': 'req-637616eb-e536-4e02-867b-093fdb22a78c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.500593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822abce2cf2b4853ade87de09e0eb091', 'request_id': 'req-637616eb-e536-4e02-867b-093fdb22a78c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.510037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822abce2cf2b4853ade87de09e0eb091', 'request_id': 'req-637616eb-e536-4e02-867b-093fdb22a78c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.523721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] The token cache is being invalidate because project 822abce2cf2b4853ade87de09e0eb091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:56.524082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.524753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.526546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 715/1449] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:56 2022] DELETE /identity/v3/projects/822abce2cf2b4853ade87de09e0eb091 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:56.531792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e6fa7-0912-43b5-9f34-ba6437a54f1a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:56.532378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e6fa7-0912-43b5-9f34-ba6437a54f1a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:56.532665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e6fa7-0912-43b5-9f34-ba6437a54f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:56.555651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-515e6fa7-0912-43b5-9f34-ba6437a54f1a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:56.557223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-515e6fa7-0912-43b5-9f34-ba6437a54f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:56.595817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:56.597870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:56.607734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:56.681389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 735/1450] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:56.684942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94925a-8f30-4ae3-a1bd-d434bcc85fc3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:56.685584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94925a-8f30-4ae3-a1bd-d434bcc85fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:56.685584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94925a-8f30-4ae3-a1bd-d434bcc85fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:56.708515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1a94925a-8f30-4ae3-a1bd-d434bcc85fc3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:56.710810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a94925a-8f30-4ae3-a1bd-d434bcc85fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:56.736697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637616eb-e536-4e02-867b-093fdb22a78c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:56.736936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 736/1451] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:56.737893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94925a-8f30-4ae3-a1bd-d434bcc85fc3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:56.748523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:56.751621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:56.751621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:56.751837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] PATH_INFO: `/v3/projects/27a9bbc390d540aeac485cace4274cff` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:56.753078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a9bbc390d540aeac485cace4274cff)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:56.753429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94925a-8f30-4ae3-a1bd-d434bcc85fc3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:56.755386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:56.761307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:56.762046 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:56.762332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:56.762607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:56.763883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:56.764570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:56.766263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:56.780522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 737/1452] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:56.786062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:56.808006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375674-c099-4f12-89c2-06ccaec1657f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:56.816553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a9bbc390d540aeac485cace4274cff', 'request_id': 'req-02e01ee2-a078-416f-8a42-c72383c92be5'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.838393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a9bbc390d540aeac485cace4274cff', 'request_id': 'req-02e01ee2-a078-416f-8a42-c72383c92be5'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.856295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a9bbc390d540aeac485cace4274cff', 'request_id': 'req-02e01ee2-a078-416f-8a42-c72383c92be5'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.875251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] The token cache is being invalidate because project 27a9bbc390d540aeac485cace4274cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:56.875471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.876219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:56.878417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 716/1453] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:56 2022] DELETE /identity/v3/projects/27a9bbc390d540aeac485cace4274cff => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:56.885914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:56.887868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:56.893530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:56.894273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:56.894726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:56.895013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:56.895735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:56.905678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e01ee2-a078-416f-8a42-c72383c92be5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:56.910580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:56.912580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:56.913303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:56.913586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:56.913862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] PATH_INFO: `/v3/users/3cf7d7df522642e39eb9108b80dfc40c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:56.915186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf7d7df522642e39eb9108b80dfc40c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:56.917108 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:56.920218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:56.967016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 738/1454] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:56 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:56.972300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:56.974817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:57.010977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf7d7df522642e39eb9108b80dfc40c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:57.011665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf7d7df522642e39eb9108b80dfc40c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:57.023625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf7d7df522642e39eb9108b80dfc40c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:57.024247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf7d7df522642e39eb9108b80dfc40c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:57.058661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf7d7df522642e39eb9108b80dfc40c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:57.079719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 717/1455] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:11:56 2022] DELETE /identity/v3/users/3cf7d7df522642e39eb9108b80dfc40c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:11:57.118062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d21fe8-28dc-4132-9fd5-d3537f188be5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:57.185334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:57.206597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:57.207584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:57.208006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:57.208484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:57.209405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:57.211644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:57.243465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 739/1456] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:56 2022] POST /identity/v3/users => generated 285 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:11:57.247877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:57.249634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:57.267582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b0e0-944a-4444-8630-acc5ed572a72 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:57.274687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:57.276381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:57.276707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:57.277273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:57.278785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:57.282051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:57.300626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 718/1457] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:57.301862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:57.314764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f4d9-a986-4705-a263-3923c16a52b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:57.321241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a4be-80a9-4d9b-a145-cb128d5e0e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:57.322963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a4be-80a9-4d9b-a145-cb128d5e0e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:57.323484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a4be-80a9-4d9b-a145-cb128d5e0e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:57.323957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a4be-80a9-4d9b-a145-cb128d5e0e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:57.325172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30a4be-80a9-4d9b-a145-cb128d5e0e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:57.327439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30a4be-80a9-4d9b-a145-cb128d5e0e4b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:57.347717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 740/1458] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:57.351796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:57.396479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49a70-cf35-4742-835a-dc12601c7e4a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:57.431844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:57.435679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:57.435679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:57.436006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] PATH_INFO: `/v3/projects/77a7942b91974aff90e5a484a4d9410d/users/c44c1d29d60e4211a28ac23950a52787/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:57.458646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a7942b91974aff90e5a484a4d9410d, user_id=c44c1d29d60e4211a28ac23950a52787, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:57.462237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:57.482238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 719/1459] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:57 2022] PUT /identity/v3/projects/77a7942b91974aff90e5a484a4d9410d/users/c44c1d29d60e4211a28ac23950a52787/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:57.493811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfdfb-7b12-4c2f-9749-701477a39f27 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:57.494544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfdfb-7b12-4c2f-9749-701477a39f27 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:57.494771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfdfb-7b12-4c2f-9749-701477a39f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:57.540339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f11dfdfb-7b12-4c2f-9749-701477a39f27 None None] MFA Rules not processed for user `c44c1d29d60e4211a28ac23950a52787`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:57.541840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f11dfdfb-7b12-4c2f-9749-701477a39f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:57.698402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 741/1460] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:57.702708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:57.799779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df342095-a340-4864-90b5-d8222b45bacc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:57.820686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7c204-1f74-4a50-98bc-fdbd11956c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:57.821397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c204-1f74-4a50-98bc-fdbd11956c68 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:57.821678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c204-1f74-4a50-98bc-fdbd11956c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:57.821952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c204-1f74-4a50-98bc-fdbd11956c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:57.822602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7c204-1f74-4a50-98bc-fdbd11956c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:57.824610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7c204-1f74-4a50-98bc-fdbd11956c68 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:57.867194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfdfb-7b12-4c2f-9749-701477a39f27 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:57.874476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 720/1461] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:57 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:57.884211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfdfb-7b12-4c2f-9749-701477a39f27 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:57.999416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be904d11-5b62-48bb-acfd-8fa6036dceb3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.000577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be904d11-5b62-48bb-acfd-8fa6036dceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.001205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be904d11-5b62-48bb-acfd-8fa6036dceb3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.003189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 721/1462] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:11:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:11:58.007204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.008207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.008582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.008864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.011317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:58.015467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039534c-d216-4c34-b2bc-c86a640000be None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.015568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039534c-d216-4c34-b2bc-c86a640000be None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.017000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039534c-d216-4c34-b2bc-c86a640000be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.028929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:58.060346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5039534c-d216-4c34-b2bc-c86a640000be None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:58.062932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5039534c-d216-4c34-b2bc-c86a640000be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:58.082913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 742/1463] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:57 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:11:58.083705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:58.108546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ca71f-30eb-40ee-98d0-b6f62495cf0a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:58.120893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.121073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.121356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.121630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.125621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:58.127315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:58.135001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:58.155675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 743/1464] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:58.158398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:58.178462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df883cd-b2c7-4ef6-b5c0-cab5465d1ede admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:58.191302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.191974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.192263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.192524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] PATH_INFO: `/v3/projects/a92d510dc09341daa1b6a3660847c8b6/users/8bc1f7084e1d48fb8e16849a85faa0d5/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.228075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 722/1465] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:58.240621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92d510dc09341daa1b6a3660847c8b6, user_id=8bc1f7084e1d48fb8e16849a85faa0d5, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:58.247594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:58.282405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 744/1466] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:58 2022] PUT /identity/v3/projects/a92d510dc09341daa1b6a3660847c8b6/users/8bc1f7084e1d48fb8e16849a85faa0d5/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:58.286408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039534c-d216-4c34-b2bc-c86a640000be None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:58.304292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039534c-d216-4c34-b2bc-c86a640000be None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:58.374149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9e454-8124-4b73-8faa-23736356c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.374950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e454-8124-4b73-8faa-23736356c3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.375406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e454-8124-4b73-8faa-23736356c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.375709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e454-8124-4b73-8faa-23736356c3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.377057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9e454-8124-4b73-8faa-23736356c3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:58.379105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9e454-8124-4b73-8faa-23736356c3fd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:58.394936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 723/1467] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:58.396129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:58.411107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9544ef6-eafa-4027-a558-e3a7380ec28e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:58.418297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.418844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.419196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.419541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] PATH_INFO: `/v3/projects/a92d510dc09341daa1b6a3660847c8b6/users/8bc1f7084e1d48fb8e16849a85faa0d5/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.421618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92d510dc09341daa1b6a3660847c8b6, user_id=8bc1f7084e1d48fb8e16849a85faa0d5, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:58.425505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:58.429003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:58.448570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 745/1468] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:58 2022] PUT /identity/v3/projects/a92d510dc09341daa1b6a3660847c8b6/users/8bc1f7084e1d48fb8e16849a85faa0d5/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:58.451374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.451839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.452533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.498425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] MFA Rules not processed for user `8bc1f7084e1d48fb8e16849a85faa0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:58.501269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:58.529669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:58.531848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:58.624428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 724/1469] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:11:58.625528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:58.627871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:58.669606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece6f1c-1271-4532-8cde-7a31ef5963e5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:58.681859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.682304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.682588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.682860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] PATH_INFO: `/v3/projects/0169a511c0994d6daaa2d48b53f0876b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.687962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0169a511c0994d6daaa2d48b53f0876b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:58.692397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:58.718116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:58.793526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c9af-e4c7-4e61-b42e-7ba31f8070ac None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:58.806884 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0169a511c0994d6daaa2d48b53f0876b', 'request_id': 'req-3b6e7e07-eace-422f-a67c-597fdf0c520d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:58.822451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0169a511c0994d6daaa2d48b53f0876b', 'request_id': 'req-3b6e7e07-eace-422f-a67c-597fdf0c520d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:58.832225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0169a511c0994d6daaa2d48b53f0876b', 'request_id': 'req-3b6e7e07-eace-422f-a67c-597fdf0c520d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:58.847845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] The token cache is being invalidate because project 0169a511c0994d6daaa2d48b53f0876b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:11:58.848140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:58.848801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:11:58.851677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 746/1470] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:11:58 2022] DELETE /identity/v3/projects/0169a511c0994d6daaa2d48b53f0876b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:11:58.857975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:58.861906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:58.932221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e7e07-eace-422f-a67c-597fdf0c520d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:58.937265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607b2f9-c434-4f16-90cb-3e738c0425fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.938387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607b2f9-c434-4f16-90cb-3e738c0425fb service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.939662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607b2f9-c434-4f16-90cb-3e738c0425fb service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.939955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607b2f9-c434-4f16-90cb-3e738c0425fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.940666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30933be1-02af-47fb-bd4a-e0bf7fd640dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:58.942179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30933be1-02af-47fb-bd4a-e0bf7fd640dd service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:58.942465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30933be1-02af-47fb-bd4a-e0bf7fd640dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:58.943420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30933be1-02af-47fb-bd4a-e0bf7fd640dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:58.944845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a607b2f9-c434-4f16-90cb-3e738c0425fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:58.946449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-30933be1-02af-47fb-bd4a-e0bf7fd640dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:58.979366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607b2f9-c434-4f16-90cb-3e738c0425fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:58.990225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607b2f9-c434-4f16-90cb-3e738c0425fb service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.031301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 725/1471] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:59.034811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25a17-0d5b-4213-b054-1a7d5658b5b4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.036567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25a17-0d5b-4213-b054-1a7d5658b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.036833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25a17-0d5b-4213-b054-1a7d5658b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.066817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:59.099121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-60f25a17-0d5b-4213-b054-1a7d5658b5b4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:59.104863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-60f25a17-0d5b-4213-b054-1a7d5658b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:59.142912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30933be1-02af-47fb-bd4a-e0bf7fd640dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:59.144920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30933be1-02af-47fb-bd4a-e0bf7fd640dd service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.206281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 747/1472] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:59.287189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 726/1473] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:59.295788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49e12-27d0-4653-9b22-954265c13321 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.296348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49e12-27d0-4653-9b22-954265c13321 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.296630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49e12-27d0-4653-9b22-954265c13321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.340349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-88c49e12-27d0-4653-9b22-954265c13321 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:59.348681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-88c49e12-27d0-4653-9b22-954265c13321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:59.409282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 748/1474] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:59.413389 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25a17-0d5b-4213-b054-1a7d5658b5b4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:59.436140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25a17-0d5b-4213-b054-1a7d5658b5b4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:59.444929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:59.445692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.446093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.446441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.447166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:11:59.447579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:59.450969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.473952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 727/1475] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:11:59.475305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49e12-27d0-4653-9b22-954265c13321 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:59.495581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49e12-27d0-4653-9b22-954265c13321 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:59.505345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:59.506648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.507076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.507426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.508906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:59.511671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.557444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 749/1476] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:11:59 2022] POST /identity/v3/projects => generated 407 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:59.562141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:59.573092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee11c4-d5cc-4258-a1a2-4c7a891615bc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:59.655953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:59.672372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:59.673612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.673974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.676137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.677388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:59.680328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.713363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 728/1477] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:11:59 2022] POST /identity/v3/users => generated 304 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:11:59.715548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:59.734689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505c99-8ca9-4194-8cd5-056596123696 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:59.756792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:59.759332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.760243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.761343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.763454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:59.773516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.810274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 750/1478] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:59.812135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:59.845397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94ebbe-2e3e-4ac8-b99b-d0569c05b602 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:59.854973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b8ce-d28a-4172-bcbd-4290fcce8245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:59.858604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b8ce-d28a-4172-bcbd-4290fcce8245 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.859762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b8ce-d28a-4172-bcbd-4290fcce8245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.861013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b8ce-d28a-4172-bcbd-4290fcce8245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.862246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351b8ce-d28a-4172-bcbd-4290fcce8245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:59.864723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351b8ce-d28a-4172-bcbd-4290fcce8245 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.895507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:59.902476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 729/1479] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:11:59.908389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71fb49-8ee9-48d8-98fc-8cdcf9633d6e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:59.913370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908df5-059d-4300-b356-48074126498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:59.915258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908df5-059d-4300-b356-48074126498e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.915552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908df5-059d-4300-b356-48074126498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.915829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908df5-059d-4300-b356-48074126498e admin admin] PATH_INFO: `/v3/projects/d9ed8accffc54f339079490ff89aaff2/users/4396493f0f894c3cbea54270273f5968/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:59.940894 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5908df5-059d-4300-b356-48074126498e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ed8accffc54f339079490ff89aaff2, user_id=4396493f0f894c3cbea54270273f5968, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:59.945624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5908df5-059d-4300-b356-48074126498e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:59.967656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 751/1480] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:11:59 2022] PUT /identity/v3/projects/d9ed8accffc54f339079490ff89aaff2/users/4396493f0f894c3cbea54270273f5968/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:11:59.981321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6473-2b46-4935-9a5d-0b135645dae4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:59.981825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6473-2b46-4935-9a5d-0b135645dae4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:59.982162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6473-2b46-4935-9a5d-0b135645dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:00.018894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-34de6473-2b46-4935-9a5d-0b135645dae4 None None] MFA Rules not processed for user `4396493f0f894c3cbea54270273f5968`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:00.020202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-34de6473-2b46-4935-9a5d-0b135645dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:00.120656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 730/1481] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:11:59 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:00.124994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908df5-059d-4300-b356-48074126498e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:00.208381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908df5-059d-4300-b356-48074126498e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:00.213693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:00.214498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:00.214787 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:00.215056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:00.215696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:00.217908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:00.288811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 752/1482] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:00 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:00.293950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6473-2b46-4935-9a5d-0b135645dae4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:00.325193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6473-2b46-4935-9a5d-0b135645dae4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:00.459932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:00.460640 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:00.461014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:00.461424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:00.462103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:00.472607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:00.525071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:00.533381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 731/1483] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:00 2022] POST /identity/v3/users => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:00.546638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40131e-a05d-4728-b5f5-4b0be4fffd78 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:00.560694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:00.561511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:00.561867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:00.563580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:00.563580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:00.565019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:00.582364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:00.594115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 753/1484] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:00.595947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf05906-0718-4980-ba7e-f741ccfde2a1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:00.611695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:00.611695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:00.615619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:00.616868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] PATH_INFO: `/v3/projects/0c4a3b8addaf4b3d9754423140f95842/users/c840453be3094a5a9ac70be6f3f2727c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:00.655601 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4a3b8addaf4b3d9754423140f95842, user_id=c840453be3094a5a9ac70be6f3f2727c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:00.662368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:00.686955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 732/1485] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:00 2022] PUT /identity/v3/projects/0c4a3b8addaf4b3d9754423140f95842/users/c840453be3094a5a9ac70be6f3f2727c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:00.691906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:00.705872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204006-5ed3-45e5-8ed6-86ff04f64e55 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:00.838848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:00.878283 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250c6e-9003-4a6d-a4b4-2e179347e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:00.879006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250c6e-9003-4a6d-a4b4-2e179347e436 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:00.879687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250c6e-9003-4a6d-a4b4-2e179347e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:00.879687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250c6e-9003-4a6d-a4b4-2e179347e436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:00.883333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250c6e-9003-4a6d-a4b4-2e179347e436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:00.885179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250c6e-9003-4a6d-a4b4-2e179347e436 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:00.920363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 754/1486] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:00.921759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:00.935448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637a025-1c07-4c13-93f7-c8915876785b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:00.947197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:00.947941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:00.948223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:00.948498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] PATH_INFO: `/v3/projects/0c4a3b8addaf4b3d9754423140f95842/users/c840453be3094a5a9ac70be6f3f2727c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:00.953557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4a3b8addaf4b3d9754423140f95842, user_id=c840453be3094a5a9ac70be6f3f2727c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:00.956383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:01.007210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 733/1487] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:00 2022] PUT /identity/v3/projects/0c4a3b8addaf4b3d9754423140f95842/users/c840453be3094a5a9ac70be6f3f2727c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:01.009083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:01.009709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:01.010180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:01.111531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] MFA Rules not processed for user `c840453be3094a5a9ac70be6f3f2727c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:01.114360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:01.261337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 755/1488] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:01.278783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:01.281757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:01.310515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:01.376158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea569443-76dc-45b9-ba1f-72544b190ce0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:01.386638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:01.387367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:01.387812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:01.388157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:01.400353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:01.402165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:01.418593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 734/1489] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:01.679704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:01.681306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:01.685372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:01.694877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4626031-ec40-494f-92e9-e1e7ab4491e1 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:01.698558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a11ef-e0fd-48ee-b146-a7f4a9f913bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:01.699156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a11ef-e0fd-48ee-b146-a7f4a9f913bd service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:01.699438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a11ef-e0fd-48ee-b146-a7f4a9f913bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:01.699720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a11ef-e0fd-48ee-b146-a7f4a9f913bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:01.760503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564e696-4a18-45fc-906e-0299dc0dacb0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:01.768333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:01.770479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:01.770479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:01.770479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] PATH_INFO: `/v3/users/c44c1d29d60e4211a28ac23950a52787` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:01.771484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44c1d29d60e4211a28ac23950a52787)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:01.773660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:01.775042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a11ef-e0fd-48ee-b146-a7f4a9f913bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:01.776901 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a11ef-e0fd-48ee-b146-a7f4a9f913bd service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:01.790822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 735/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:01 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:01.865284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44c1d29d60e4211a28ac23950a52787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:01.865284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44c1d29d60e4211a28ac23950a52787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:01.865284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44c1d29d60e4211a28ac23950a52787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:01.865284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44c1d29d60e4211a28ac23950a52787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:01.876045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:01.878821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44c1d29d60e4211a28ac23950a52787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:01.896603 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 756/1491] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:01 2022] DELETE /identity/v3/users/c44c1d29d60e4211a28ac23950a52787 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:01.901836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:01.902310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:01.902744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:01.929405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:01.930787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:01.998564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 736/1492] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:02.009281 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:02.010864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:02.071991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298a05-f600-4fed-a590-73db188e7796 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:02.075835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:02.076474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:02.076781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:02.077058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:02.089825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:02.091317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:02.102939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 757/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:02.549230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:02.551046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:02.575492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca835855-0332-4897-b0cd-51d4b2537966 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:02.590208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:02.594532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:02.595447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:02.596763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] PATH_INFO: `/v3/projects/77a7942b91974aff90e5a484a4d9410d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:02.600773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a7942b91974aff90e5a484a4d9410d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:02.606328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:02.702675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a7942b91974aff90e5a484a4d9410d', 'request_id': 'req-da78359f-f577-452b-948a-8b412238d78c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.706219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:02.715017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a7942b91974aff90e5a484a4d9410d', 'request_id': 'req-da78359f-f577-452b-948a-8b412238d78c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.727718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a7942b91974aff90e5a484a4d9410d', 'request_id': 'req-da78359f-f577-452b-948a-8b412238d78c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.749131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] The token cache is being invalidate because project 77a7942b91974aff90e5a484a4d9410d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:02.749468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.751295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.756416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 737/1494] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:02 2022] DELETE /identity/v3/projects/77a7942b91974aff90e5a484a4d9410d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:02.757655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:02.772857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb782-3761-45fe-8b30-a4aca2aeeb2b service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:02.872042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:02.872756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:02.873005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:02.873297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] PATH_INFO: `/v3/users/8bc1f7084e1d48fb8e16849a85faa0d5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:02.874621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc1f7084e1d48fb8e16849a85faa0d5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:02.877091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:02.935227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc1f7084e1d48fb8e16849a85faa0d5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.943127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc1f7084e1d48fb8e16849a85faa0d5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.943797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc1f7084e1d48fb8e16849a85faa0d5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.944404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc1f7084e1d48fb8e16849a85faa0d5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.960019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4799e655-6f0d-4dee-9002-316331112d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc1f7084e1d48fb8e16849a85faa0d5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:02.976244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 758/1495] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:02 2022] DELETE /identity/v3/users/8bc1f7084e1d48fb8e16849a85faa0d5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:03.061070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:03.062525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:03.076021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78359f-f577-452b-948a-8b412238d78c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:03.138598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:03.139337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.139702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.140079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] PATH_INFO: `/v3/users/9152a02c12c046d6a9bb5943be68317f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.141389 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9152a02c12c046d6a9bb5943be68317f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:03.143422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:03.199985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9152a02c12c046d6a9bb5943be68317f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.200873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9152a02c12c046d6a9bb5943be68317f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.230903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9152a02c12c046d6a9bb5943be68317f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.231953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9152a02c12c046d6a9bb5943be68317f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.252152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9152a02c12c046d6a9bb5943be68317f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.267640 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 738/1496] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:03 2022] DELETE /identity/v3/users/9152a02c12c046d6a9bb5943be68317f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:03.273167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.273624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.275029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.302502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:03.304087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:03.310123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:03.394790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:03.396889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:03.402855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 759/1497] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:03.415482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:03.417013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:03.448160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1e420-be3c-4139-b989-cf70bbbd1d2a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:03.464017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:03.464866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.465766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.466195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] PATH_INFO: `/v3/projects/a92d510dc09341daa1b6a3660847c8b6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.467527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92d510dc09341daa1b6a3660847c8b6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:03.472258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:03.508689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b6168-50d4-4f3d-a3e0-fa3e992519b9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:03.514244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abd4a4-b527-43bf-b5ce-ce8053293575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:03.515254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd4a4-b527-43bf-b5ce-ce8053293575 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.515540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd4a4-b527-43bf-b5ce-ce8053293575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.515815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd4a4-b527-43bf-b5ce-ce8053293575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.533414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92d510dc09341daa1b6a3660847c8b6', 'request_id': 'req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.534125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abd4a4-b527-43bf-b5ce-ce8053293575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:03.536010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abd4a4-b527-43bf-b5ce-ce8053293575 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:03.538084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:03.542517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92d510dc09341daa1b6a3660847c8b6', 'request_id': 'req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.553033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 760/1498] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:03.558230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92d510dc09341daa1b6a3660847c8b6', 'request_id': 'req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.578543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] The token cache is being invalidate because project a92d510dc09341daa1b6a3660847c8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:03.579486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.580248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71e6e115-65db-4ba8-b8ae-5bca58cc5c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:03.585011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 739/1499] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:03 2022] DELETE /identity/v3/projects/a92d510dc09341daa1b6a3660847c8b6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:03.588207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad2f8-1ae9-4a28-91e7-824313942a24 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.588664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad2f8-1ae9-4a28-91e7-824313942a24 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.589747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad2f8-1ae9-4a28-91e7-824313942a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.617295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-db9ad2f8-1ae9-4a28-91e7-824313942a24 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:03.618730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-db9ad2f8-1ae9-4a28-91e7-824313942a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:03.705471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 761/1500] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:03.713078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b0d2-a1c0-438c-8c63-d79f354d3480 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.713683 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b0d2-a1c0-438c-8c63-d79f354d3480 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.713683 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141b0d2-a1c0-438c-8c63-d79f354d3480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.735378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7141b0d2-a1c0-438c-8c63-d79f354d3480 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:03.736904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7141b0d2-a1c0-438c-8c63-d79f354d3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:03.747563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 740/1501] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:03.748735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad2f8-1ae9-4a28-91e7-824313942a24 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:03.759399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad2f8-1ae9-4a28-91e7-824313942a24 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:03.765867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:03.767547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.768052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.768499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.769374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:03.769849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:03.771962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:03.794905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 762/1502] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:12:03.796556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141b0d2-a1c0-438c-8c63-d79f354d3480 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:03.809804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141b0d2-a1c0-438c-8c63-d79f354d3480 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:03.816463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:03.817570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:03.818075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:03.818559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:03.819528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:03.822035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:03.885200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 741/1503] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:03 2022] POST /identity/v3/projects => generated 401 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:03.885945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:03.903570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edb45e-f96a-468f-9235-999bb2304453 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:03.997061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:04.020457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.022534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:04.056677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.059298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.061708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.062080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.064029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.071614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.130684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 763/1504] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:03 2022] POST /identity/v3/users => generated 301 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:04.137600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.171562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d30eb8-9dad-403a-a245-a07c130de468 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.176019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf3307-a5c2-4d1b-9164-b239a0ffca45 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.186867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.188089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.188548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.188669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.188833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.188939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.189139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] PATH_INFO: `/v3/projects/df47d0d136df4c76a07d59d4489a98ac` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.189300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.204502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.204734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df47d0d136df4c76a07d59d4489a98ac)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.204835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.204922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.232379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 764/1505] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:04.238017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.251735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dda80f-e8dd-4a9c-8816-c90ae9dd6c8d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.256762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.257625 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.257978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.258373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.259088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.260789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.277153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 765/1506] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:04.278443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.302420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7b91e-3da8-4e25-bccc-230a5ce38d59 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.304178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df47d0d136df4c76a07d59d4489a98ac', 'request_id': 'req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.311626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df47d0d136df4c76a07d59d4489a98ac', 'request_id': 'req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.322701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df47d0d136df4c76a07d59d4489a98ac', 'request_id': 'req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.342914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] The token cache is being invalidate because project df47d0d136df4c76a07d59d4489a98ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:04.343210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.345475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.349620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 742/1507] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:04 2022] DELETE /identity/v3/projects/df47d0d136df4c76a07d59d4489a98ac => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:04.353834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.355722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:04.385864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a801d-7d88-4a81-9eeb-4f7b29378a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.386839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a801d-7d88-4a81-9eeb-4f7b29378a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.387192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a801d-7d88-4a81-9eeb-4f7b29378a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.387565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a801d-7d88-4a81-9eeb-4f7b29378a50 admin admin] PATH_INFO: `/v3/projects/8a8b5303262949dcb50b743c91f1e77a/users/577b2c974ef64cbf8ad96bf279c1fb46/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.410673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a801d-7d88-4a81-9eeb-4f7b29378a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8b5303262949dcb50b743c91f1e77a, user_id=577b2c974ef64cbf8ad96bf279c1fb46, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.413982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a801d-7d88-4a81-9eeb-4f7b29378a50 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.417578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:04.433671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 766/1508] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:04 2022] PUT /identity/v3/projects/8a8b5303262949dcb50b743c91f1e77a/users/577b2c974ef64cbf8ad96bf279c1fb46/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:04.446666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.446957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.447237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.481820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e47d2-d49e-4300-ac3d-de08bc8eb293 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.484124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] MFA Rules not processed for user `577b2c974ef64cbf8ad96bf279c1fb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:04.486026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:04.593332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 767/1509] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:04 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:04.598086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.599428 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:04.601646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.602621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.602984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.603330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] PATH_INFO: `/v3/users/54b2aeee0c554ed9abdd85954ec8f6b8` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.604550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b2aeee0c554ed9abdd85954ec8f6b8)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.606607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.614108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23304a0-63a3-46a8-9685-6ff3be6028d7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.618951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.619562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.619836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.620100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.620744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.622739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.653196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:04.664087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 768/1510] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:04 2022] POST /identity/v3/projects => generated 397 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:04.665180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.761108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040b82-779a-4547-9a55-7edbf9aada8c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.767085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.767941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.768372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.768791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.769613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.772080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.804190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 769/1511] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:04 2022] POST /identity/v3/users => generated 305 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:04.814851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.834300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b2aeee0c554ed9abdd85954ec8f6b8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.835509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b2aeee0c554ed9abdd85954ec8f6b8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.840720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e659ec-ca7b-4701-b3f4-80e6de92b09e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.844364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b2aeee0c554ed9abdd85954ec8f6b8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.845133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b2aeee0c554ed9abdd85954ec8f6b8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.851547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.852180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.852730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.853089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:04.853682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:04.855288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:04.861509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b2aeee0c554ed9abdd85954ec8f6b8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:04.888479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 770/1513] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:04.889205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 743/1513] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:04 2022] DELETE /identity/v3/users/54b2aeee0c554ed9abdd85954ec8f6b8 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:04.889316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:04.889316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:04.901369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab53b36-04e6-43d4-b05b-c75812de1c56 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:04.986129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:04.987248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:04.990944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:04.991335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] PATH_INFO: `/v3/projects/a07b854c8e12438e8d1340f731f2e939/users/955b66d8996d417e80a13e23f84aa4de/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:05.033611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07b854c8e12438e8d1340f731f2e939, user_id=955b66d8996d417e80a13e23f84aa4de, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:05.036745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:05.059858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 771/1514] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:04 2022] PUT /identity/v3/projects/a07b854c8e12438e8d1340f731f2e939/users/955b66d8996d417e80a13e23f84aa4de/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:05.064292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:05.076459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb115f-ad9f-4a37-b29f-d2a3c2d32d7c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:05.187145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f680fa7-ff35-42c4-9a55-574f62bed61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:05.187785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680fa7-ff35-42c4-9a55-574f62bed61a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:05.188585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680fa7-ff35-42c4-9a55-574f62bed61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:05.188989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680fa7-ff35-42c4-9a55-574f62bed61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:05.189859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f680fa7-ff35-42c4-9a55-574f62bed61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:05.191611 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f680fa7-ff35-42c4-9a55-574f62bed61a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:05.227563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:05.233102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 744/1515] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:05.245766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b14b8-ebe5-4b65-81d8-55754b77c7dd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:05.255695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:05.256744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:05.257257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:05.257759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] PATH_INFO: `/v3/projects/a07b854c8e12438e8d1340f731f2e939/users/955b66d8996d417e80a13e23f84aa4de/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:05.261756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07b854c8e12438e8d1340f731f2e939, user_id=955b66d8996d417e80a13e23f84aa4de, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:05.267239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:05.292754 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 772/1516] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:05 2022] PUT /identity/v3/projects/a07b854c8e12438e8d1340f731f2e939/users/955b66d8996d417e80a13e23f84aa4de/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:05.305165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcd99-3b57-4e60-bf42-fa27bb710bc3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:05.305757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcd99-3b57-4e60-bf42-fa27bb710bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:05.306252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcd99-3b57-4e60-bf42-fa27bb710bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:05.331280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:05.356180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-80abcd99-3b57-4e60-bf42-fa27bb710bc3 None None] MFA Rules not processed for user `955b66d8996d417e80a13e23f84aa4de`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:05.358492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-80abcd99-3b57-4e60-bf42-fa27bb710bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:05.503806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 745/1517] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:05 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:05.517313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:05.519049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:05.579956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:05.589428 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef76636-66ea-41a7-bdb7-6a98d8e7557d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:05.593780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:05.594567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:05.594973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:05.595804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:05.605954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:05.607540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:05.619366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 773/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:05 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:05.735258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abcd99-3b57-4e60-bf42-fa27bb710bc3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:05.745917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abcd99-3b57-4e60-bf42-fa27bb710bc3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:05.750052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e97c2-7d8f-4f60-a7da-843b691d5b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:05.750777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e97c2-7d8f-4f60-a7da-843b691d5b45 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:05.751059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e97c2-7d8f-4f60-a7da-843b691d5b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:05.751334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e97c2-7d8f-4f60-a7da-843b691d5b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:05.753165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2f1e97c2-7d8f-4f60-a7da-843b691d5b45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:05.826216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e97c2-7d8f-4f60-a7da-843b691d5b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:05.827666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e97c2-7d8f-4f60-a7da-843b691d5b45 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:05.853941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 746/1519] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:05 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:06.255175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:06.256673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:06.347743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322010c6-b972-4c1e-abe9-d0ff964c3c3d service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:06.352903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:06.353528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.353808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.354079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] PATH_INFO: `/v3/projects/fdb18ad933c34b418b9472e51cab1cd1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.355196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb18ad933c34b418b9472e51cab1cd1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:06.357183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:06.409789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb18ad933c34b418b9472e51cab1cd1', 'request_id': 'req-436f90b5-f57c-4679-afec-19ce79a2f5da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:06.418448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb18ad933c34b418b9472e51cab1cd1', 'request_id': 'req-436f90b5-f57c-4679-afec-19ce79a2f5da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:06.425308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb18ad933c34b418b9472e51cab1cd1', 'request_id': 'req-436f90b5-f57c-4679-afec-19ce79a2f5da'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:06.437133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] The token cache is being invalidate because project fdb18ad933c34b418b9472e51cab1cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:06.437463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:06.438172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-436f90b5-f57c-4679-afec-19ce79a2f5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:06.439775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 774/1520] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:06 2022] DELETE /identity/v3/projects/fdb18ad933c34b418b9472e51cab1cd1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:06.444621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d82152-1a1e-489c-9a9d-8563e4d39f96 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.445002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d82152-1a1e-489c-9a9d-8563e4d39f96 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.445313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d82152-1a1e-489c-9a9d-8563e4d39f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.473122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-93d82152-1a1e-489c-9a9d-8563e4d39f96 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:06.474343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-93d82152-1a1e-489c-9a9d-8563e4d39f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:06.540963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 747/1521] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:06.549855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d198-4c7b-48e6-903a-5dc93f444f0b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.550156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d198-4c7b-48e6-903a-5dc93f444f0b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.550406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d198-4c7b-48e6-903a-5dc93f444f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.581813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5134d198-4c7b-48e6-903a-5dc93f444f0b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:06.583015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5134d198-4c7b-48e6-903a-5dc93f444f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:06.591098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 775/1522] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:06.595381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d82152-1a1e-489c-9a9d-8563e4d39f96 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:06.605575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d82152-1a1e-489c-9a9d-8563e4d39f96 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:06.610612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:06.611217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.611491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.611762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.612400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:06.612700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:06.614322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:06.626977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 748/1523] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:12:06.631305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134d198-4c7b-48e6-903a-5dc93f444f0b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:06.640445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134d198-4c7b-48e6-903a-5dc93f444f0b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:06.645033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:06.645643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.645918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.646188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.646812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:06.648740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:06.682273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 776/1524] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:06 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:06.683553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:06.693861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07e9a-6de3-4917-a8b4-c6d561534e96 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:06.706172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:06.758199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:06.758820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.759098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.759368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.759991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:06.761938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:06.785170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 749/1525] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:06 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:06.789312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:06.801071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b8220-fe80-4576-bcbb-890ef58c980a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:06.805670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:06.806339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.806701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.807065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.807764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:06.809494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:06.824162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 777/1526] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:06.825791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:06.835870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970ef9-a27b-4773-bc8a-3d21dc072391 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:06.841660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc3ca4-a441-4f4a-95bd-688ae69f5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:06.842266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3ca4-a441-4f4a-95bd-688ae69f5db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.842554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3ca4-a441-4f4a-95bd-688ae69f5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.842822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3ca4-a441-4f4a-95bd-688ae69f5db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.843451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3ca4-a441-4f4a-95bd-688ae69f5db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:06.845620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3ca4-a441-4f4a-95bd-688ae69f5db3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:06.856075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 750/1527] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:06.861226 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:06.872234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d1fda-f5a7-4916-b40f-ee9ec2c7206e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:06.877946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:06.878662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.878989 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.879266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] PATH_INFO: `/v3/projects/5426f2d8fe9c4e2ba38b573cfcaf9da9/users/3b8f6a9fdb884c618e31ead30c4e86bd/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.900078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5426f2d8fe9c4e2ba38b573cfcaf9da9, user_id=3b8f6a9fdb884c618e31ead30c4e86bd, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:06.903410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:06.925019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 778/1528] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:06 2022] PUT /identity/v3/projects/5426f2d8fe9c4e2ba38b573cfcaf9da9/users/3b8f6a9fdb884c618e31ead30c4e86bd/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:06.939193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831b9f-c4d4-4f4f-b9b7-b22087237359 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:06.939814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831b9f-c4d4-4f4f-b9b7-b22087237359 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:06.940086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831b9f-c4d4-4f4f-b9b7-b22087237359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:06.996749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b6831b9f-c4d4-4f4f-b9b7-b22087237359 None None] MFA Rules not processed for user `3b8f6a9fdb884c618e31ead30c4e86bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:06.998126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b6831b9f-c4d4-4f4f-b9b7-b22087237359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:07.141493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 751/1529] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:07.146809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:07.167013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:07.283256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584200c-fc04-45a3-a4cf-234549d55d65 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:07.328016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:07.329204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.329491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.329762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.330402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:07.341204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:07.417530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 779/1530] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:07 2022] POST /identity/v3/projects => generated 391 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:07.421743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6831b9f-c4d4-4f4f-b9b7-b22087237359 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:07.437387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6831b9f-c4d4-4f4f-b9b7-b22087237359 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:07.519391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:07.520112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.520493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.520866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.522182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:07.525485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:07.555603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 752/1531] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:07 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:07.559440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:07.584205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f978e-69ee-40e0-9dfd-317b840395d5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:07.595635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:07.596464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.597117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.597639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.599646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:07.602020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:07.633628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 780/1532] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:07.639171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:07.651394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658bc7f-47fb-4007-a141-d5c4d92bcdec admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:07.672264 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:07.674112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.674112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.674112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] PATH_INFO: `/v3/projects/70dff1571c874badae85a4b70a66b776/users/49410557a1ce4e17b45389582b91f8df/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.688439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:07.690404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:07.697837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:07.701513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dff1571c874badae85a4b70a66b776, user_id=49410557a1ce4e17b45389582b91f8df, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:07.704504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54c28-e879-4a92-a3e1-ced27155336d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:07.704939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:07.711614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:07.712401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.712698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.712965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] PATH_INFO: `/v3/users/4396493f0f894c3cbea54270273f5968` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.714151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4396493f0f894c3cbea54270273f5968)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:07.716191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:07.727187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 753/1533] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:07 2022] PUT /identity/v3/projects/70dff1571c874badae85a4b70a66b776/users/49410557a1ce4e17b45389582b91f8df/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:07.731118 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:07.808041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4396493f0f894c3cbea54270273f5968'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:07.818890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4396493f0f894c3cbea54270273f5968'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:07.819176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94957c-f6fd-4e81-ad0e-2ef3d246c6fb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:07.819812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4396493f0f894c3cbea54270273f5968'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:07.820547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4396493f0f894c3cbea54270273f5968'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:07.824581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:07.826075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.826473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.826822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.827700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:07.830991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:07.837390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff36157e-d018-4042-9875-cab49d8211e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4396493f0f894c3cbea54270273f5968'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:07.844806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 754/1534] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:07.848895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:07.851072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:07.865019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 781/1535] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:07 2022] DELETE /identity/v3/users/4396493f0f894c3cbea54270273f5968 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:07.870811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.870811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.870811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.872460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8f76-a8da-439f-9719-5c723952e270 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:07.920787 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:07.922420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:07.990450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b9125-a70a-4658-b383-210241e47c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:07.993092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9125-a70a-4658-b383-210241e47c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:07.993564 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9125-a70a-4658-b383-210241e47c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:07.994221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9125-a70a-4658-b383-210241e47c6d admin admin] PATH_INFO: `/v3/projects/70dff1571c874badae85a4b70a66b776/users/49410557a1ce4e17b45389582b91f8df/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:07.997957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b9125-a70a-4658-b383-210241e47c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dff1571c874badae85a4b70a66b776, user_id=49410557a1ce4e17b45389582b91f8df, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:08.002036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b9125-a70a-4658-b383-210241e47c6d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:08.017572 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 755/1536] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:07 2022] PUT /identity/v3/projects/70dff1571c874badae85a4b70a66b776/users/49410557a1ce4e17b45389582b91f8df/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:08.026878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 782/1537] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:08.028647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:08.029733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:08.030029 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:08.035932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:08.038370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:08.047423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:08.072966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] MFA Rules not processed for user `49410557a1ce4e17b45389582b91f8df`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:08.074243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:08.172895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 756/1538] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:08.182037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:08.185708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:08.194008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3521a57-481e-49ba-9ba0-cc87c222c2dd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:08.214005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:08.289693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76696b55-92d8-4224-8fb8-76d46c54d204 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:08.293625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:08.294091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:08.294369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:08.294636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:08.314703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:08.318477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:08.331692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:08.332561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:08.332851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:08.333394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:08.342837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 757/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:08.434458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:08.443706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd0f6b-c94b-4106-8fcd-d4cbdf11a73a service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:08.453391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:08.454662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:08.456206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:08.456367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:08.460924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:08.533529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:08.537018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:08.559443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 783/1540] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:08.582420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:08.585206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:08.619730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 758/1541] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:09.048630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:09.050258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:09.092614 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781e1be-5cdd-49cc-9b37-1d964f8b4bee service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:09.116996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:09.120868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:09.121367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:09.122507 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] PATH_INFO: `/v3/projects/d9ed8accffc54f339079490ff89aaff2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:09.138440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ed8accffc54f339079490ff89aaff2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:09.138440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:09.257146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ed8accffc54f339079490ff89aaff2', 'request_id': 'req-1c4afa42-a6f7-4468-92ce-f473491c36fa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.271516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ed8accffc54f339079490ff89aaff2', 'request_id': 'req-1c4afa42-a6f7-4468-92ce-f473491c36fa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.285540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:09.288348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ed8accffc54f339079490ff89aaff2', 'request_id': 'req-1c4afa42-a6f7-4468-92ce-f473491c36fa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.312049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] The token cache is being invalidate because project d9ed8accffc54f339079490ff89aaff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:09.314132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.314977 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.316956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 784/1542] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:09 2022] DELETE /identity/v3/projects/d9ed8accffc54f339079490ff89aaff2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:09.320620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:09.334126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89280f5c-d5b9-45f3-884a-3143f03f4d8d service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:09.455731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:09.456382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:09.456659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:09.456927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] PATH_INFO: `/v3/users/c840453be3094a5a9ac70be6f3f2727c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:09.458096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c840453be3094a5a9ac70be6f3f2727c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:09.460538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:09.553335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c840453be3094a5a9ac70be6f3f2727c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.554022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c840453be3094a5a9ac70be6f3f2727c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.557383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:09.578362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c840453be3094a5a9ac70be6f3f2727c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.580395 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c840453be3094a5a9ac70be6f3f2727c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.604077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cda5607-6764-4310-a4ff-cb3da683659c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c840453be3094a5a9ac70be6f3f2727c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:09.621359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 759/1543] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:09 2022] DELETE /identity/v3/users/c840453be3094a5a9ac70be6f3f2727c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:10.139543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:10.141543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:10.158205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4afa42-a6f7-4468-92ce-f473491c36fa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:10.240673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:10.241433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.241901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.242127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] PATH_INFO: `/v3/projects/0c4a3b8addaf4b3d9754423140f95842` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.245753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4a3b8addaf4b3d9754423140f95842)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:10.248094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:10.297886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4a3b8addaf4b3d9754423140f95842', 'request_id': 'req-28a155ca-3ce9-4621-ac35-c8490aa30760'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:10.306424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4a3b8addaf4b3d9754423140f95842', 'request_id': 'req-28a155ca-3ce9-4621-ac35-c8490aa30760'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:10.313175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4a3b8addaf4b3d9754423140f95842', 'request_id': 'req-28a155ca-3ce9-4621-ac35-c8490aa30760'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:10.324848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] The token cache is being invalidate because project 0c4a3b8addaf4b3d9754423140f95842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:10.325168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:10.325812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-28a155ca-3ce9-4621-ac35-c8490aa30760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:10.331224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 785/1544] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:10 2022] DELETE /identity/v3/projects/0c4a3b8addaf4b3d9754423140f95842 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:10.335725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade051-50a1-432f-a725-5abf01321090 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.336169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade051-50a1-432f-a725-5abf01321090 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.336293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade051-50a1-432f-a725-5abf01321090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.356774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6fade051-50a1-432f-a725-5abf01321090 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:10.358041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6fade051-50a1-432f-a725-5abf01321090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:10.450433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 760/1545] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:10.459822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec601-7ec9-4e7f-b69a-cc89dfa415e7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.460250 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec601-7ec9-4e7f-b69a-cc89dfa415e7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.460653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eec601-7ec9-4e7f-b69a-cc89dfa415e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.495795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-74eec601-7ec9-4e7f-b69a-cc89dfa415e7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:10.498149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-74eec601-7ec9-4e7f-b69a-cc89dfa415e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:10.523107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 786/1546] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:10.528288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fade051-50a1-432f-a725-5abf01321090 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:10.543642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fade051-50a1-432f-a725-5abf01321090 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:10.551714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:10.552505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.553026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.553465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.554305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:10.554750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:10.556709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:10.587405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec601-7ec9-4e7f-b69a-cc89dfa415e7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:10.594027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 761/1547] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:12:10.603336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eec601-7ec9-4e7f-b69a-cc89dfa415e7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:10.615943 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:10.617125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.619559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.623845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.625983 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:10.634030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:10.733010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 787/1548] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:10 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:10.735632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:10.750754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061cf6-4446-4023-a551-21dd29b1fd3e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:10.886843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:10.887459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.887732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.888024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.888741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:10.891908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:10.917003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 762/1549] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:10 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:10.919193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:10.930799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662a7a-dbbd-4903-8756-c9dc6baf4776 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:10.937879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:10.938273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:10.938718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.939088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.939419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.940070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:10.940301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:10.941740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:10.952579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224447f-a6f0-4b7b-b917-2c82af00e8ed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:10.957600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 788/1550] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:10.958467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:10.960873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:10.961573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.961852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.962124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] PATH_INFO: `/v3/users/577b2c974ef64cbf8ad96bf279c1fb46` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.963276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577b2c974ef64cbf8ad96bf279c1fb46)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:10.965266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:10.972310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6d280-d2f2-444f-9fcc-3e3b40f419cd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:10.985630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:10.986265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:10.986551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:10.986824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:10.987518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:10.991056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:11.006177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 789/1551] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:11.007474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:11.019671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975e15-4bd8-4e0d-b7b0-75cdc50960fe admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:11.025257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f5583-af36-4a3b-bd84-623264c876e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:11.025930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f5583-af36-4a3b-bd84-623264c876e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:11.026215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f5583-af36-4a3b-bd84-623264c876e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:11.026487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f5583-af36-4a3b-bd84-623264c876e5 admin admin] PATH_INFO: `/v3/projects/4b9027f16cfa4a79a0645f59a245f0db/users/1033657eaf894660b6cc34492b19acea/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:11.029707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:11.042309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577b2c974ef64cbf8ad96bf279c1fb46'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.043357 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577b2c974ef64cbf8ad96bf279c1fb46'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.050948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f5583-af36-4a3b-bd84-623264c876e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9027f16cfa4a79a0645f59a245f0db, user_id=1033657eaf894660b6cc34492b19acea, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:11.054212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f5583-af36-4a3b-bd84-623264c876e5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:11.057787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577b2c974ef64cbf8ad96bf279c1fb46'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.058496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577b2c974ef64cbf8ad96bf279c1fb46'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.081875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e162562c-9d6e-4d2f-8d49-0d29be3b9825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577b2c974ef64cbf8ad96bf279c1fb46'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.084031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 790/1552] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:11 2022] PUT /identity/v3/projects/4b9027f16cfa4a79a0645f59a245f0db/users/1033657eaf894660b6cc34492b19acea/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:11.096535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bac38-2194-4816-af43-67a4ea570445 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:11.097134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bac38-2194-4816-af43-67a4ea570445 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:11.097601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bac38-2194-4816-af43-67a4ea570445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:11.105060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 763/1553] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:10 2022] DELETE /identity/v3/users/577b2c974ef64cbf8ad96bf279c1fb46 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:11.117851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:11.120505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:11.120860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:11.121142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:11.145077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:11.146546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:11.155806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-282bac38-2194-4816-af43-67a4ea570445 None None] MFA Rules not processed for user `1033657eaf894660b6cc34492b19acea`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:11.157609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-282bac38-2194-4816-af43-67a4ea570445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:11.249867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 791/1554] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:11.256427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 764/1555] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:11.264381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bac38-2194-4816-af43-67a4ea570445 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:11.265322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:11.266072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-282bac38-2194-4816-af43-67a4ea570445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:11.268027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:11.342338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bac38-2194-4816-af43-67a4ea570445 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:11.348548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:11.350697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:11.351156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:11.351466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:11.354599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0d5d-10e7-48cc-8f9a-e96b02239a1c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:11.358663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:11.359275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:11.359563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:11.359911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:11.366941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:11.369089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:11.373020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:11.374538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:11.382816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 792/1556] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:11.392567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 765/1557] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:11.710671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:11.712203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:11.740369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb92b-1074-4bd8-a1b9-9646daeb51b4 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:11.745313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:11.746032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:11.746378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:11.746718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] PATH_INFO: `/v3/projects/8a8b5303262949dcb50b743c91f1e77a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:11.748052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8b5303262949dcb50b743c91f1e77a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:11.750106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:11.805017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8b5303262949dcb50b743c91f1e77a', 'request_id': 'req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.812536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8b5303262949dcb50b743c91f1e77a', 'request_id': 'req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.818545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8b5303262949dcb50b743c91f1e77a', 'request_id': 'req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.834385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] The token cache is being invalidate because project 8a8b5303262949dcb50b743c91f1e77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:11.834826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.836016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:11.838438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 793/1558] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:11 2022] DELETE /identity/v3/projects/8a8b5303262949dcb50b743c91f1e77a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:11.843032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:11.861192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff915c-9125-4a38-af42-007ed6366430 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:11.957850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:11.958799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:11.959081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:11.959351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] PATH_INFO: `/v3/users/955b66d8996d417e80a13e23f84aa4de` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:11.960641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955b66d8996d417e80a13e23f84aa4de)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:11.962659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:11.965899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:12.025690 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955b66d8996d417e80a13e23f84aa4de'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.026786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955b66d8996d417e80a13e23f84aa4de'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.036737 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955b66d8996d417e80a13e23f84aa4de'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.037458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955b66d8996d417e80a13e23f84aa4de'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.052072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ec5331c8-4d39-4d8b-9b4f-7276873e32c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955b66d8996d417e80a13e23f84aa4de'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.066001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 766/1559] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:11 2022] DELETE /identity/v3/users/955b66d8996d417e80a13e23f84aa4de => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:12.395177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:12.396608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:12.414442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e81d4-1b7f-40bf-b8e2-65ea9dc81b59 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:12.442212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:12.513213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:12.514008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:12.514348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:12.514715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] PATH_INFO: `/v3/projects/a07b854c8e12438e8d1340f731f2e939` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:12.516573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07b854c8e12438e8d1340f731f2e939)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:12.518712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:12.582228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07b854c8e12438e8d1340f731f2e939', 'request_id': 'req-3d59168d-fd81-4a7f-8a8b-c940a62ea978'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.589496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07b854c8e12438e8d1340f731f2e939', 'request_id': 'req-3d59168d-fd81-4a7f-8a8b-c940a62ea978'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.597498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07b854c8e12438e8d1340f731f2e939', 'request_id': 'req-3d59168d-fd81-4a7f-8a8b-c940a62ea978'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.609874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] The token cache is being invalidate because project a07b854c8e12438e8d1340f731f2e939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:12.610321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.611000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.616314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 794/1560] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:12 2022] DELETE /identity/v3/projects/a07b854c8e12438e8d1340f731f2e939 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:12.618108 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f09ed-d780-473b-8ad2-20e143d9efe1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:12.618552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f09ed-d780-473b-8ad2-20e143d9efe1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:12.618845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f09ed-d780-473b-8ad2-20e143d9efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:12.632615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:12.634689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:12.643388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2e7f09ed-d780-473b-8ad2-20e143d9efe1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:12.644628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e7f09ed-d780-473b-8ad2-20e143d9efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:12.713853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 767/1561] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:12.722278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59168d-fd81-4a7f-8a8b-c940a62ea978 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:12.723320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be858418-e9ca-44ab-828a-135444aba683 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:12.723619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be858418-e9ca-44ab-828a-135444aba683 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:12.723887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be858418-e9ca-44ab-828a-135444aba683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:12.737782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:12.738851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:12.739150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:12.739530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] PATH_INFO: `/v3/users/3b8f6a9fdb884c618e31ead30c4e86bd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:12.740757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8f6a9fdb884c618e31ead30c4e86bd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:12.743324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:12.756484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-be858418-e9ca-44ab-828a-135444aba683 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:12.757586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-be858418-e9ca-44ab-828a-135444aba683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:12.769124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 768/1562] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:12.772140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be858418-e9ca-44ab-828a-135444aba683 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:12.787244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be858418-e9ca-44ab-828a-135444aba683 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:12.792753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:12.793589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:12.793870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:12.794147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:12.795270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:12.795270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:12.804819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:12.811800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8f6a9fdb884c618e31ead30c4e86bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.827095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:12.830245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8f6a9fdb884c618e31ead30c4e86bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.831755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8f6a9fdb884c618e31ead30c4e86bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.833075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8f6a9fdb884c618e31ead30c4e86bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.842838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 769/1563] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:12:12.847595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:12.849415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:12.857919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c8242b57-097d-4908-877a-3e7c1daf2580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8f6a9fdb884c618e31ead30c4e86bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:12.873506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2cd68-f075-4277-a200-2405740dee08 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:12.879402 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:12.880079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:12.880361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:12.880637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:12.881466 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:12.883458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:12.887671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 795/1564] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:12 2022] DELETE /identity/v3/users/3b8f6a9fdb884c618e31ead30c4e86bd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:12.889598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:12.890122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:12.890623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:12.922477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 770/1565] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:12 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:12.930070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:12.936193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:12.941014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:12.989007 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:13.023606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f41d7-f248-4472-b9d6-382c15534564 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.035307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.035952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.036269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.036543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.037285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.039319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.041462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 796/1566] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:13.052207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.054030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:13.076106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 771/1567] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:12 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:13.080625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.096094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258917f5-90ce-4bbc-b8dd-0648edc17b22 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.100922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.101572 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.101849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.102115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.103752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.109586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.120158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 772/1568] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:13.121290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.137571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3ca5-54ed-4b3c-9f84-8128550823ce admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.146786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.147849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.148199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.148906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.149658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.152405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.169830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8300-e783-44ac-a4d5-2628676bff4c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.170049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 773/1569] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:13.174173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.177214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3d1a0-b0af-4f2d-a4af-da854bcee1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.177861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d1a0-b0af-4f2d-a4af-da854bcee1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.178140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d1a0-b0af-4f2d-a4af-da854bcee1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.178408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d1a0-b0af-4f2d-a4af-da854bcee1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.186347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea63473-7a68-407c-84f2-972892877936 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.189445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3d1a0-b0af-4f2d-a4af-da854bcee1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.191542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3d1a0-b0af-4f2d-a4af-da854bcee1d7 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.193355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.194697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.195166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.195441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] PATH_INFO: `/v3/projects/27d6ea3e642a4abd8e8a1b696767def4/users/b8797caf801547f69cab8d7e47b7a29b/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.210288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 797/1570] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:13.217904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d6ea3e642a4abd8e8a1b696767def4, user_id=b8797caf801547f69cab8d7e47b7a29b, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.221038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.248543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 774/1571] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:13 2022] PUT /identity/v3/projects/27d6ea3e642a4abd8e8a1b696767def4/users/b8797caf801547f69cab8d7e47b7a29b/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:13.260887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6183-da01-458f-804c-ca20482d695e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.261219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6183-da01-458f-804c-ca20482d695e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.261494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6183-da01-458f-804c-ca20482d695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.314113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-741f6183-da01-458f-804c-ca20482d695e None None] MFA Rules not processed for user `b8797caf801547f69cab8d7e47b7a29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:13.315709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-741f6183-da01-458f-804c-ca20482d695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:13.421497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 798/1572] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:13.426403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.503756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3693c2a-cce0-4a4f-b70b-76bce7e85fd5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.510867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.512630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.513802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.514320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.515181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.517359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.556227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 775/1573] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:13 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:13.560352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f6183-da01-458f-804c-ca20482d695e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.568470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:13.573851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f6183-da01-458f-804c-ca20482d695e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.667097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.667736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.668151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.668441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.669201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.671049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.672608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.675876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:13.715038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940b18a-f227-41d9-9fab-31b93184f0c8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.721030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 799/1574] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:13 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:13.723778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.727588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.728588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.729080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.729609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] PATH_INFO: `/v3/projects/5426f2d8fe9c4e2ba38b573cfcaf9da9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.732646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5426f2d8fe9c4e2ba38b573cfcaf9da9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.735206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.739422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd195c-8e80-428d-8a45-9e4d996b6d50 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.745010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.745851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.746383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.746860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.747681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.749574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.764944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 800/1575] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:13.766627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.780362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d41781-2154-487d-b259-85ff59be5434 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.800404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.801443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.802969 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.803397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] PATH_INFO: `/v3/projects/7ec175b4785443cbbf69c527cfe5846e/users/575d08ecc19e4f1595227a2f8435a424/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.811862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5426f2d8fe9c4e2ba38b573cfcaf9da9', 'request_id': 'req-36bcc902-6854-42ea-a314-f1b29f9adbf9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:13.831616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec175b4785443cbbf69c527cfe5846e, user_id=575d08ecc19e4f1595227a2f8435a424, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.834021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5426f2d8fe9c4e2ba38b573cfcaf9da9', 'request_id': 'req-36bcc902-6854-42ea-a314-f1b29f9adbf9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:13.836914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.838171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:13.846461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5426f2d8fe9c4e2ba38b573cfcaf9da9', 'request_id': 'req-36bcc902-6854-42ea-a314-f1b29f9adbf9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:13.861599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 801/1576] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:13 2022] PUT /identity/v3/projects/7ec175b4785443cbbf69c527cfe5846e/users/575d08ecc19e4f1595227a2f8435a424/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:13.866188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.871685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] The token cache is being invalidate because project 5426f2d8fe9c4e2ba38b573cfcaf9da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:13.872323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:13.874156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:13.877166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 776/1577] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:13 2022] DELETE /identity/v3/projects/5426f2d8fe9c4e2ba38b573cfcaf9da9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:13.883833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.885286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:13.942671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc461d-a919-47e4-8b4f-aea0824f18af admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.947712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.948364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.948650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.949117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.949775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.951386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.962784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcc902-6854-42ea-a314-f1b29f9adbf9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.966827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 802/1578] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:13.968179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:13.971182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:13.971947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.972769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.973249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.973669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] PATH_INFO: `/v3/users/49410557a1ce4e17b45389582b91f8df` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.974940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49410557a1ce4e17b45389582b91f8df)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:13.977286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:13.985094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316367fc-0c60-4ec8-a4a6-3e9b315706dc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:13.990855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dd55b-2b65-4fcc-b749-5d57438f0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:13.991625 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dd55b-2b65-4fcc-b749-5d57438f0b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:13.993303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dd55b-2b65-4fcc-b749-5d57438f0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:13.993303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dd55b-2b65-4fcc-b749-5d57438f0b3f admin admin] PATH_INFO: `/v3/projects/7ec175b4785443cbbf69c527cfe5846e/users/575d08ecc19e4f1595227a2f8435a424/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:13.999690 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dd55b-2b65-4fcc-b749-5d57438f0b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec175b4785443cbbf69c527cfe5846e, user_id=575d08ecc19e4f1595227a2f8435a424, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:14.004312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835dd55b-2b65-4fcc-b749-5d57438f0b3f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:14.037390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 803/1579] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:13 2022] PUT /identity/v3/projects/7ec175b4785443cbbf69c527cfe5846e/users/575d08ecc19e4f1595227a2f8435a424/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:14.037390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:14.037390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:14.037390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:14.084734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49410557a1ce4e17b45389582b91f8df'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:14.090105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49410557a1ce4e17b45389582b91f8df'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:14.092006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] MFA Rules not processed for user `575d08ecc19e4f1595227a2f8435a424`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:14.093407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:14.119393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49410557a1ce4e17b45389582b91f8df'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:14.124148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49410557a1ce4e17b45389582b91f8df'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:14.139834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:14.151077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49410557a1ce4e17b45389582b91f8df'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:14.169290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 777/1580] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:13 2022] DELETE /identity/v3/users/49410557a1ce4e17b45389582b91f8df => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:14.204149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 804/1581] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:14.212888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:14.214354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:14.279589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789da6-83e5-495e-b382-e002f0164882 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:14.283818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:14.284428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:14.284710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:14.285062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:14.320629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:14.398377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:14.401078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:14.416613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 778/1582] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:14.942056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:14.944143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:14.976748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:14.979440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.135919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7bf3b-690c-490f-8e5b-cbddd4792e73 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:15.141820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:15.142480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.142761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.143040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] PATH_INFO: `/v3/users/1033657eaf894660b6cc34492b19acea` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.147310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1033657eaf894660b6cc34492b19acea)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:15.149326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:15.167943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393a70-f764-4ec4-b480-c703dd4f0aed service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:15.173431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:15.174078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.174360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.174629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] PATH_INFO: `/v3/projects/70dff1571c874badae85a4b70a66b776` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.175842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70dff1571c874badae85a4b70a66b776)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:15.177777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:15.228216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1033657eaf894660b6cc34492b19acea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.236588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1033657eaf894660b6cc34492b19acea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.237684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1033657eaf894660b6cc34492b19acea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.238391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1033657eaf894660b6cc34492b19acea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.260420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1033657eaf894660b6cc34492b19acea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.286051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 805/1583] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:14 2022] DELETE /identity/v3/users/1033657eaf894660b6cc34492b19acea => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:15.287296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:15.289211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.304355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70dff1571c874badae85a4b70a66b776', 'request_id': 'req-492e271d-2589-4d7e-8ce4-b1b1db0284a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.318221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70dff1571c874badae85a4b70a66b776', 'request_id': 'req-492e271d-2589-4d7e-8ce4-b1b1db0284a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.331805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70dff1571c874badae85a4b70a66b776', 'request_id': 'req-492e271d-2589-4d7e-8ce4-b1b1db0284a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.353926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] The token cache is being invalidate because project 70dff1571c874badae85a4b70a66b776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:15.354240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.356250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-492e271d-2589-4d7e-8ce4-b1b1db0284a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.361903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 779/1584] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:14 2022] DELETE /identity/v3/projects/70dff1571c874badae85a4b70a66b776 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:15.363346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52e6f-2586-440d-b9c3-37672e5b9e91 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.363785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52e6f-2586-440d-b9c3-37672e5b9e91 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.364073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52e6f-2586-440d-b9c3-37672e5b9e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.373359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:15.402360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e3ed2-fb47-4dfc-94ca-85be46b7f286 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:15.407808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-72f52e6f-2586-440d-b9c3-37672e5b9e91 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:15.408119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:15.408867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.409290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.409769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] PATH_INFO: `/v3/users/b8797caf801547f69cab8d7e47b7a29b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.411078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8797caf801547f69cab8d7e47b7a29b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:15.413455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:15.415748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-72f52e6f-2586-440d-b9c3-37672e5b9e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.431954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 780/1585] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:15.433394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.433679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.433953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.482107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:15.483331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.498153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8797caf801547f69cab8d7e47b7a29b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.498751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 781/1586] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:15.500139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:15.503182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.527282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8797caf801547f69cab8d7e47b7a29b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.529653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8797caf801547f69cab8d7e47b7a29b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.532616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8797caf801547f69cab8d7e47b7a29b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.554057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4e8c4f-0893-4640-9a20-e84cc732e25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8797caf801547f69cab8d7e47b7a29b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:15.586397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 806/1587] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:15 2022] DELETE /identity/v3/users/b8797caf801547f69cab8d7e47b7a29b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:15.592546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5340d-f053-4c23-a687-81b3253f2c27 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.593215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5340d-f053-4c23-a687-81b3253f2c27 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.593959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5340d-f053-4c23-a687-81b3253f2c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.603555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:15.639174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-26a5340d-f053-4c23-a687-81b3253f2c27 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:15.640069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-26a5340d-f053-4c23-a687-81b3253f2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.641151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637e04-0543-448d-be0a-f27a75d97de3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:15.750051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:15.751215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.751489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.751758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.756397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.773607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 807/1588] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:15.774929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.775277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.775617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.784698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:15.790643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:15.813328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 782/1589] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:15.814673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:15.824257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:15.825763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.840229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38240e-d8a2-4f4d-83dc-c710f0392404 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:15.842279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 808/1590] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:15.848644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:15.849463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.849916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.850344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.851344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:15.852074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:15.854130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:15.863255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:15.865796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:15.869883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 783/1591] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:12:15.876288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:15.885757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a849197-991b-40bd-84cf-63328ca8ecff None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:15.894447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:15.895012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.895429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.895709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.901545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd6f26-f0b7-45e8-8f86-32c8ba1bdb33 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:15.909893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:15.912025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:15.914247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:15.915392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:15.915684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:15.915957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:15.916598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:15.918588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:15.938591 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 809/1592] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:15.974379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 784/1593] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:15 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:15.978728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:15.994931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34b7d1-89ff-4b8c-8cb2-d393ed57b6d3 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.138330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:16.171419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.172794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.175127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.175473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.176097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.180785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.233223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 810/1594] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:15 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:16.238191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:16.251222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08edb6-7f46-485f-9684-49fb370e9ba7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.256622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.257655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.258206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.258687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.259568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.261486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.274813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 785/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:16.277973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:16.304686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a7d2-dc75-4f70-82a1-10767278e8fa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.318712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b6ea-e58e-4c35-96f6-9977cf070460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.320482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b6ea-e58e-4c35-96f6-9977cf070460 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.321776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b6ea-e58e-4c35-96f6-9977cf070460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.322367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b6ea-e58e-4c35-96f6-9977cf070460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.323579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37b6ea-e58e-4c35-96f6-9977cf070460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.332709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37b6ea-e58e-4c35-96f6-9977cf070460 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.349368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 811/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:16.354137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:16.367022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f9973-675a-476b-81fb-12bbf159405b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.373686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.374804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.376070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.376746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] PATH_INFO: `/v3/projects/adc132dd502744eea5fce17f03ebdf13/users/1065c50740a64c18b963f9fd482044a5/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.401590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc132dd502744eea5fce17f03ebdf13, user_id=1065c50740a64c18b963f9fd482044a5, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.404260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.427834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 786/1597] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:16 2022] PUT /identity/v3/projects/adc132dd502744eea5fce17f03ebdf13/users/1065c50740a64c18b963f9fd482044a5/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:16.439769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.440086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.440343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.474261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] MFA Rules not processed for user `1065c50740a64c18b963f9fd482044a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:16.475608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:16.557484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:16.559432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:16.601653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 812/1598] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:16.607148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:16.609255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:16.669634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f3712-bbdb-477f-a65c-c1825f5e0b5f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.674589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.675236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.675554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.675801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] PATH_INFO: `/v3/projects/4b9027f16cfa4a79a0645f59a245f0db` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.676953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9027f16cfa4a79a0645f59a245f0db)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.679092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.703720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e586e-98e3-455f-beb9-6c9cd2b45b42 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.710859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.711734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.712201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.712634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] PATH_INFO: `/v3/projects/27d6ea3e642a4abd8e8a1b696767def4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.714028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d6ea3e642a4abd8e8a1b696767def4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.716084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:16.716230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.741780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9027f16cfa4a79a0645f59a245f0db', 'request_id': 'req-88341b57-4f9a-4cf5-908f-92bfd382b99a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.748880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9027f16cfa4a79a0645f59a245f0db', 'request_id': 'req-88341b57-4f9a-4cf5-908f-92bfd382b99a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.758516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9027f16cfa4a79a0645f59a245f0db', 'request_id': 'req-88341b57-4f9a-4cf5-908f-92bfd382b99a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.772513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] The token cache is being invalidate because project 4b9027f16cfa4a79a0645f59a245f0db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:16.772802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.773573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.774017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d6ea3e642a4abd8e8a1b696767def4', 'request_id': 'req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.777253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 787/1599] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:16 2022] DELETE /identity/v3/projects/4b9027f16cfa4a79a0645f59a245f0db => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:16.778240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:16.779790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:16.786119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d6ea3e642a4abd8e8a1b696767def4', 'request_id': 'req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.787850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:16.794896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d6ea3e642a4abd8e8a1b696767def4', 'request_id': 'req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.812259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] The token cache is being invalidate because project 27d6ea3e642a4abd8e8a1b696767def4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:16.812556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.813324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8ae6b77-bcbc-4903-93d6-e85311e3ebd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:16.815339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 813/1600] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:16 2022] DELETE /identity/v3/projects/27d6ea3e642a4abd8e8a1b696767def4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:16.817047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.817341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.817759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.847442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:16.848771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:16.857229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88341b57-4f9a-4cf5-908f-92bfd382b99a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.920103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6cf1-9ff1-4c6b-bb49-d60ed6088066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.920640 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6cf1-9ff1-4c6b-bb49-d60ed6088066 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.920916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6cf1-9ff1-4c6b-bb49-d60ed6088066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.921218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6cf1-9ff1-4c6b-bb49-d60ed6088066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.922862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c6cf1-9ff1-4c6b-bb49-d60ed6088066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.924433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c6cf1-9ff1-4c6b-bb49-d60ed6088066 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.925685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 814/1601] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:16.926739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:16.928704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:16.943090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54bc54-a775-46de-9eac-607c61b98c5a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:16.949251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:16.949895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.950189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.950454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] PATH_INFO: `/v3/users/575d08ecc19e4f1595227a2f8435a424` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.951968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=575d08ecc19e4f1595227a2f8435a424)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:16.954739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:16.961987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 788/1602] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:16 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:16.961987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1ae5-0a05-4aab-9c09-b2e7340c3603 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:16.961987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1ae5-0a05-4aab-9c09-b2e7340c3603 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:16.961987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1ae5-0a05-4aab-9c09-b2e7340c3603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:16.987066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-667f1ae5-0a05-4aab-9c09-b2e7340c3603 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:16.988627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-667f1ae5-0a05-4aab-9c09-b2e7340c3603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:17.012502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575d08ecc19e4f1595227a2f8435a424'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.020673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575d08ecc19e4f1595227a2f8435a424'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.021506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575d08ecc19e4f1595227a2f8435a424'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.022145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575d08ecc19e4f1595227a2f8435a424'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.035178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575d08ecc19e4f1595227a2f8435a424'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.036723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:17.052058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 815/1603] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:16 2022] DELETE /identity/v3/users/575d08ecc19e4f1595227a2f8435a424 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:17.052906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.054288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:17.066164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 789/1604] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:17.071014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f1ae5-0a05-4aab-9c09-b2e7340c3603 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.081883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f1ae5-0a05-4aab-9c09-b2e7340c3603 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.131260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:17.134797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef1702-b715-41b7-a84b-32ecca871eef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.144572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.146201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.147092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.147377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.148042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.151654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.169056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.170185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.170404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.170683 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.171959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:17.172998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.180707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.184588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 816/1605] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:17 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:17.188331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.204308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976fa5-6226-422b-a4c7-5985d3710d7c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.205038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 790/1606] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:12:17.209713 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.214096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.215777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.216128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.217152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.217867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.220003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.225030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09843b-0167-4ca2-8d1d-18701f7cf14f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.231329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.231853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.232137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.232413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.233123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.235260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.252755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 817/1607] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:17.254220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.271442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ba2ab-d242-4603-893a-603cf8d094cd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.278362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.279530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.280058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.280599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] PATH_INFO: `/v3/projects/94281107e32d4c62a83c14e74533d80a/users/cc4e3277551148d489b2be314f355d06/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.284684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 791/1608] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:17 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:17.285698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.311330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94281107e32d4c62a83c14e74533d80a, user_id=cc4e3277551148d489b2be314f355d06, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.315319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.341692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 818/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:17 2022] PUT /identity/v3/projects/94281107e32d4c62a83c14e74533d80a/users/cc4e3277551148d489b2be314f355d06/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:17.343274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.399695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a5054-42d6-4185-9360-580c35370ca6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.476608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd74bc2-4ba3-4cf4-b9d1-f2629705f960 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.488345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.489413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.489923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.490401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.491223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.515559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.517055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.517413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.518370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.519801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.520995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.523133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.538314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:17.551466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 819/1610] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:17.552453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 792/1611] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:17 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:17.556300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.556471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.572316 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503507-2feb-4755-92c8-90e2d3402088 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.578136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638244c-901a-4e00-8353-be0215521010 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.582763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.583447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.583812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.584991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.585843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.587535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5cb6a-0133-4844-b82c-45c40937f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.587920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.588223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cb6a-0133-4844-b82c-45c40937f75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.588508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cb6a-0133-4844-b82c-45c40937f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.588870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cb6a-0133-4844-b82c-45c40937f75f admin admin] PATH_INFO: `/v3/projects/94281107e32d4c62a83c14e74533d80a/users/cc4e3277551148d489b2be314f355d06/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.593344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5cb6a-0133-4844-b82c-45c40937f75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94281107e32d4c62a83c14e74533d80a, user_id=cc4e3277551148d489b2be314f355d06, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.596390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5cb6a-0133-4844-b82c-45c40937f75f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.622149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 793/1612] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:17.629823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 820/1613] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:17 2022] PUT /identity/v3/projects/94281107e32d4c62a83c14e74533d80a/users/cc4e3277551148d489b2be314f355d06/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:17.630638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.640595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224681a1-14b7-4b99-8c0f-6c8727a380be None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.641700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224681a1-14b7-4b99-8c0f-6c8727a380be None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.642112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224681a1-14b7-4b99-8c0f-6c8727a380be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.670400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb25f54-7952-469f-baa2-766afae60947 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.694994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-224681a1-14b7-4b99-8c0f-6c8727a380be None None] MFA Rules not processed for user `cc4e3277551148d489b2be314f355d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:17.697595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-224681a1-14b7-4b99-8c0f-6c8727a380be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:17.763995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.766435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.766718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.766994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.767831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.769535 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.780822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 794/1614] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:17.783106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.785569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:17.790945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 821/1615] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:17.791800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224681a1-14b7-4b99-8c0f-6c8727a380be None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.804523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36558d-6adc-4a36-9b18-b0d974f7775a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.808189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224681a1-14b7-4b99-8c0f-6c8727a380be None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.809636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.810390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.810731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.811086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] PATH_INFO: `/v3/projects/7ec175b4785443cbbf69c527cfe5846e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.812292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec175b4785443cbbf69c527cfe5846e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.813218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:17.813887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.814181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.814453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] PATH_INFO: `/v3/projects/0033cf99df3443cfa354e056fe28840f/users/9b39b03c3c124a38a6ef8b162af9a127/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.814658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.830280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0033cf99df3443cfa354e056fe28840f, user_id=9b39b03c3c124a38a6ef8b162af9a127, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:17.832962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:17.836596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:17.858107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 822/1616] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:17 2022] PUT /identity/v3/projects/0033cf99df3443cfa354e056fe28840f/users/9b39b03c3c124a38a6ef8b162af9a127/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:17.859064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:17.861319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:17.873419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec175b4785443cbbf69c527cfe5846e', 'request_id': 'req-6d4eb55d-4f74-4a01-9b4a-615455a70bba'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.879161 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec175b4785443cbbf69c527cfe5846e', 'request_id': 'req-6d4eb55d-4f74-4a01-9b4a-615455a70bba'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.887458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec175b4785443cbbf69c527cfe5846e', 'request_id': 'req-6d4eb55d-4f74-4a01-9b4a-615455a70bba'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.899990 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] The token cache is being invalidate because project 7ec175b4785443cbbf69c527cfe5846e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:17.900278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.900964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d4eb55d-4f74-4a01-9b4a-615455a70bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:17.902724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 795/1617] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:17 2022] DELETE /identity/v3/projects/7ec175b4785443cbbf69c527cfe5846e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:17.903898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c74e53-afe6-4326-9280-36929774796e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:17.904180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c74e53-afe6-4326-9280-36929774796e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:17.904450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c74e53-afe6-4326-9280-36929774796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:17.922132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1b834-4f94-4d10-9a9a-60a3bb8762cb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:17.933841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-45c74e53-afe6-4326-9280-36929774796e None None] MFA Rules not processed for user `9b39b03c3c124a38a6ef8b162af9a127`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:17.935333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-45c74e53-afe6-4326-9280-36929774796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:18.010362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.011101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.011853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.012304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.014379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:18.016176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:18.029046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 796/1618] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:18.030502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4dfe3-9d18-44d8-9b21-cb9bfde7324e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.030785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4dfe3-9d18-44d8-9b21-cb9bfde7324e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.031055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4dfe3-9d18-44d8-9b21-cb9bfde7324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.052657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-dfc4dfe3-9d18-44d8-9b21-cb9bfde7324e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:18.053901 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dfc4dfe3-9d18-44d8-9b21-cb9bfde7324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:18.092598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.094120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.104071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 823/1619] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:18.104932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.106317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:18.132615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 797/1620] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:18.142510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423b4f-6cc8-47bf-8c72-d848ae9772b1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.142807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423b4f-6cc8-47bf-8c72-d848ae9772b1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.143087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423b4f-6cc8-47bf-8c72-d848ae9772b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.166774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-19423b4f-6cc8-47bf-8c72-d848ae9772b1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:18.168209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-19423b4f-6cc8-47bf-8c72-d848ae9772b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:18.177066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 798/1621] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:18.181078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423b4f-6cc8-47bf-8c72-d848ae9772b1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.193319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423b4f-6cc8-47bf-8c72-d848ae9772b1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.199164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.199970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.200220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.200559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.201239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:18.201670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.203316 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.225296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 799/1622] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:12:18.226148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.237039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471027-afa3-4b96-920c-34df9445feff admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.242691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.242953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.243236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.243511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.244154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.246191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.280025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 800/1623] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:18 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:18.282130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.319288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b018216-5ff0-476b-8bf8-aea7536ba5ea service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.325712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:18.356828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4b45-6e01-401d-9bd6-bdf5bde89cd2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.361608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.362338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.362630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.363061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.363749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.365864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.383448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.384064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.384340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.384610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.385306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.387230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.394562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 801/1624] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:18 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:18.398839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.413757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7091f28-bf0f-4de0-96da-6dfa77bdbe68 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.417036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.417848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.418123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.418392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.419031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.420636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.428262 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 824/1625] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:18 2022] POST /identity/v3/projects => generated 375 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:18.429162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.436589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 802/1626] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:18.437703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.447965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461da43-c795-417d-b05b-ae2ca8350e29 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.544846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:18.552069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503733-2093-4adc-be01-42b9d33d650d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.561606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.562401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.562712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.567919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.569357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.572803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.636266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.637843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.638546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.639277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.640537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.642899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 825/1627] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:18 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:18.644766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.646101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.669083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 803/1628] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:18.673535 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.687535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b521d-3818-4e6c-8cf1-f4441b89ad2f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.701946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.702587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.702750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5801d-c5fb-4fe2-bde5-fbbd5310015c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.702857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.703129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.703831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.709833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.714934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19200ef9-ca6e-40fb-bf78-67057cc17d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.716911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200ef9-ca6e-40fb-bf78-67057cc17d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.718508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200ef9-ca6e-40fb-bf78-67057cc17d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.719686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200ef9-ca6e-40fb-bf78-67057cc17d94 admin admin] PATH_INFO: `/v3/projects/1b36b0110a564ad983f7988a3be6a421/users/43e5281b5a25456ca20def3a811390bb/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.738187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 826/1629] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:18.742872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:18.745975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19200ef9-ca6e-40fb-bf78-67057cc17d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b36b0110a564ad983f7988a3be6a421, user_id=43e5281b5a25456ca20def3a811390bb, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.749019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19200ef9-ca6e-40fb-bf78-67057cc17d94 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:18.767373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319f61-32fd-4bde-ade7-299740feb3c8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:18.771620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 804/1630] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:18 2022] PUT /identity/v3/projects/1b36b0110a564ad983f7988a3be6a421/users/43e5281b5a25456ca20def3a811390bb/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:18.783527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6788b1-888f-42fa-8faf-525df8973fbb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.787141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6788b1-888f-42fa-8faf-525df8973fbb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.788006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6788b1-888f-42fa-8faf-525df8973fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.851173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c6788b1-888f-42fa-8faf-525df8973fbb None None] MFA Rules not processed for user `43e5281b5a25456ca20def3a811390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:18.852928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c6788b1-888f-42fa-8faf-525df8973fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:18.970034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:18.972682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:18.973870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:18.975531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:18.976733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:18.980377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.018952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 827/1631] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:19.020647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 805/1632] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:19.025325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6788b1-888f-42fa-8faf-525df8973fbb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.025873 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.030188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:19.042448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6788b1-888f-42fa-8faf-525df8973fbb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.062082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.062459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93cdb9-1109-406f-a09e-8ce2ec734e57 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.063340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.063618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.063888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] PATH_INFO: `/v3/projects/8d57a2f447d6443a813bcd9027d234b1/users/6e79449b50e24c6ba6d66d36987041d9/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.081123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.083259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.083699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.083972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] PATH_INFO: `/v3/users/1065c50740a64c18b963f9fd482044a5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.085796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57a2f447d6443a813bcd9027d234b1, user_id=6e79449b50e24c6ba6d66d36987041d9, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.087111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1065c50740a64c18b963f9fd482044a5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.090302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.090868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.094899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:19.120820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 806/1633] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:19 2022] PUT /identity/v3/projects/8d57a2f447d6443a813bcd9027d234b1/users/6e79449b50e24c6ba6d66d36987041d9/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:19.123376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.183995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1065c50740a64c18b963f9fd482044a5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:19.194437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1065c50740a64c18b963f9fd482044a5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:19.195073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1065c50740a64c18b963f9fd482044a5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:19.195708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1065c50740a64c18b963f9fd482044a5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:19.206588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b9123-7e7d-4e89-94de-e8416253f4f8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.213163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-52678a58-6069-4207-b781-f9b6242243c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1065c50740a64c18b963f9fd482044a5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:19.213675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cf532-6e22-41dd-8afe-afd7635bd3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.214522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf532-6e22-41dd-8afe-afd7635bd3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.214982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf532-6e22-41dd-8afe-afd7635bd3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.215400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf532-6e22-41dd-8afe-afd7635bd3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.216312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cf532-6e22-41dd-8afe-afd7635bd3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.218755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cf532-6e22-41dd-8afe-afd7635bd3b9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.234360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 828/1634] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:19 2022] DELETE /identity/v3/users/1065c50740a64c18b963f9fd482044a5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:19.236757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.237155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:19.237592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.238133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.253720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 807/1635] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:19.255428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.255930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.256392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.272706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] MFA Rules not processed for user `6e79449b50e24c6ba6d66d36987041d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:19.273998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:19.277628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:19.278973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:19.345859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 829/1636] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:19.346742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 808/1637] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:19.350392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.351114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.352175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:19.353642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:19.366808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39368-09f5-4b4b-bf23-9ff6b49ffb6a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.368584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29ab2-0b10-4092-9bb8-4946cb9d1a88 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.371619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.372290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.372778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.373077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.373266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.373711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.373844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.374127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.374396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.375859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.376300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.378067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.407955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 809/1638] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:19.409224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.410843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:19.411294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 830/1639] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:19.412107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.422641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa573d0-397c-4eb7-9d9e-cecf5c12f870 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.475970 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:19.488039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.488676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.488962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.489284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.489933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.491890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.493939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d488d-bbbb-47d3-933d-51ed757d3933 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.499991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.503159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.503833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.504293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.523191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.526125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.537430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 831/1640] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:19.537430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.544216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 810/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:19.545656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.559670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afb894-e5ff-4871-9d17-6a9531a2a1a8 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.565596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.566662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.567180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.568298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.569232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.572251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.576581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2f763-2000-40c8-b647-e52560145edb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.589338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 811/1642] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:19.593227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.594574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.594911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.595202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.595862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.597654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.608486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.618876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 832/1643] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:19.623079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.628441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8bec-cd7b-4947-b73e-03cf154a15d8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.633292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.634133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.634426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.634701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] PATH_INFO: `/v3/projects/7ffc2e62be3d4ab8b6897089ef70c3ed/users/736c2646767543e79877ba1c548b92b4/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.641940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d00ee-eea1-49e3-a84f-e60fcbbfa6a3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.663945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.665335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.665733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.666037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffc2e62be3d4ab8b6897089ef70c3ed, user_id=736c2646767543e79877ba1c548b92b4, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.666176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] PATH_INFO: `/v3/projects/e79daf85165243fda6dde19b1c745237/users/f4fd533e03b54160b7667458d5963759/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.669183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.693996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 812/1644] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:19 2022] PUT /identity/v3/projects/7ffc2e62be3d4ab8b6897089ef70c3ed/users/736c2646767543e79877ba1c548b92b4/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:19.697952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79daf85165243fda6dde19b1c745237, user_id=f4fd533e03b54160b7667458d5963759, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.698120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.702212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.728879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 833/1645] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:19 2022] PUT /identity/v3/projects/e79daf85165243fda6dde19b1c745237/users/f4fd533e03b54160b7667458d5963759/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:19.732868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.765744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:19.789475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55427a-f267-4c3e-8dc8-58f4552b8689 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.846499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79e26c-dd8c-485e-bda7-7cb8f0867ca3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.854963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.860407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.860745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.861059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.861737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.866318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.871342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.872320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.872767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.873243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.874180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.877256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.880406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 834/1646] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:19.884737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.895252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 813/1647] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:19.899873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:19.901973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79497f9-b164-4436-a092-86e590951d9a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.910446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a717e6-ef5e-40b6-af8d-95c1f8d402e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.911537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a717e6-ef5e-40b6-af8d-95c1f8d402e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.913054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a717e6-ef5e-40b6-af8d-95c1f8d402e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.913363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a717e6-ef5e-40b6-af8d-95c1f8d402e9 admin admin] PATH_INFO: `/v3/projects/e79daf85165243fda6dde19b1c745237/users/f4fd533e03b54160b7667458d5963759/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.914366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04174c0-65d8-4fa5-a779-adf3f0c509d9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:19.916563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a717e6-ef5e-40b6-af8d-95c1f8d402e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79daf85165243fda6dde19b1c745237, user_id=f4fd533e03b54160b7667458d5963759, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.920441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febca59-56e3-438a-a4b8-6e19b7aba27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:19.921291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febca59-56e3-438a-a4b8-6e19b7aba27a admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.921573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febca59-56e3-438a-a4b8-6e19b7aba27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.922272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febca59-56e3-438a-a4b8-6e19b7aba27a admin admin] PATH_INFO: `/v3/projects/7ffc2e62be3d4ab8b6897089ef70c3ed/users/736c2646767543e79877ba1c548b92b4/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.924591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febca59-56e3-438a-a4b8-6e19b7aba27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffc2e62be3d4ab8b6897089ef70c3ed, user_id=736c2646767543e79877ba1c548b92b4, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:19.927431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febca59-56e3-438a-a4b8-6e19b7aba27a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.934029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a717e6-ef5e-40b6-af8d-95c1f8d402e9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:19.940360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 814/1648] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:19 2022] PUT /identity/v3/projects/7ffc2e62be3d4ab8b6897089ef70c3ed/users/736c2646767543e79877ba1c548b92b4/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:19.950708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.950997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.951271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:19.966824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 835/1649] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:19 2022] PUT /identity/v3/projects/e79daf85165243fda6dde19b1c745237/users/f4fd533e03b54160b7667458d5963759/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:19.968480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:19.969036 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:19.970122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:20.012000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] MFA Rules not processed for user `736c2646767543e79877ba1c548b92b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:20.013261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:20.026931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] MFA Rules not processed for user `f4fd533e03b54160b7667458d5963759`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:20.028523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:20.192642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 815/1650] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:20.201199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 836/1651] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:20.214610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:20.216289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:20.217455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:20.219694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:20.249029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:20.314541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3f222-56a0-421f-9289-199cc1a8ff6f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:20.320580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:20.321347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:20.321539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:20.321794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:20.329222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb1934-0752-495f-90a5-27c1392a3dbb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:20.334052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:20.335445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:20.341502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:20.342680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:20.343308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:20.343784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:20.346362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 837/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:20.354155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:20.365801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:20.441124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:20.444219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:20.455449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 816/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:20.455612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:20.474947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d218aa-c04d-4415-bc3a-59e050058175 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:20.481039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:20.481963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:20.481963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:20.482247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:20.487136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:20.489173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:20.492782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:20.581215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:20.582685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:20.588935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332f351-1c81-4d3c-b396-b14e941be721 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:20.592060 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 838/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:20.595644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:20.596401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:20.596709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:20.597125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] PATH_INFO: `/v3/projects/adc132dd502744eea5fce17f03ebdf13` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:20.598380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc132dd502744eea5fce17f03ebdf13)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:20.600398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:20.666087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc132dd502744eea5fce17f03ebdf13', 'request_id': 'req-a0ce500d-4752-4ac4-b689-1ec3713c49d2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.675946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc132dd502744eea5fce17f03ebdf13', 'request_id': 'req-a0ce500d-4752-4ac4-b689-1ec3713c49d2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.684745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc132dd502744eea5fce17f03ebdf13', 'request_id': 'req-a0ce500d-4752-4ac4-b689-1ec3713c49d2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.699676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] The token cache is being invalidate because project adc132dd502744eea5fce17f03ebdf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:20.699972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.700618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.702430 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 817/1655] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:20 2022] DELETE /identity/v3/projects/adc132dd502744eea5fce17f03ebdf13 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:20.707526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:20.721318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a20b2-e07c-4390-b465-3f151e3665ee service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:20.784233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:20.784887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:20.785202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:20.785479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] PATH_INFO: `/v3/users/cc4e3277551148d489b2be314f355d06` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:20.786837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4e3277551148d489b2be314f355d06)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:20.788772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:20.878345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4e3277551148d489b2be314f355d06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.896467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4e3277551148d489b2be314f355d06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.897802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4e3277551148d489b2be314f355d06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.898458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4e3277551148d489b2be314f355d06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.909470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:20.926402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d1a80e1-6062-4170-9b9d-c2935bb8511f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4e3277551148d489b2be314f355d06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:20.949579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 839/1656] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:20 2022] DELETE /identity/v3/users/cc4e3277551148d489b2be314f355d06 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:20.993260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:20.995278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:21.015083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce500d-4752-4ac4-b689-1ec3713c49d2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.082309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:21.112387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.122982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.123296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.123732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] PATH_INFO: `/v3/users/43e5281b5a25456ca20def3a811390bb` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.126150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e5281b5a25456ca20def3a811390bb)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.128378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.177355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e5281b5a25456ca20def3a811390bb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.178012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e5281b5a25456ca20def3a811390bb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.185800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e5281b5a25456ca20def3a811390bb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.186438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e5281b5a25456ca20def3a811390bb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.205706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e5281b5a25456ca20def3a811390bb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.219233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 818/1657] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:20 2022] DELETE /identity/v3/users/43e5281b5a25456ca20def3a811390bb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:21.223795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.224681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.225157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.248577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:21.248577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:21.338034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 840/1658] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:21.346631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.349010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:21.358552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.360857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:21.391602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9c2b-e3ca-443a-9a13-de5836410920 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.397500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.398426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.398903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.399882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] PATH_INFO: `/v3/projects/94281107e32d4c62a83c14e74533d80a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.402161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94281107e32d4c62a83c14e74533d80a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.406198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.485195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94281107e32d4c62a83c14e74533d80a', 'request_id': 'req-85dfe91e-15d9-43d5-b7f3-68a8cb913139'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.490500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe96785-a311-42f7-84b8-347a76f8bd1c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.497956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94281107e32d4c62a83c14e74533d80a', 'request_id': 'req-85dfe91e-15d9-43d5-b7f3-68a8cb913139'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.509031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94281107e32d4c62a83c14e74533d80a', 'request_id': 'req-85dfe91e-15d9-43d5-b7f3-68a8cb913139'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.530263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] The token cache is being invalidate because project 94281107e32d4c62a83c14e74533d80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:21.530263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.530263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-85dfe91e-15d9-43d5-b7f3-68a8cb913139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:21.530263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 841/1659] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:21 2022] DELETE /identity/v3/projects/94281107e32d4c62a83c14e74533d80a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:21.541078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d9092-8549-4b61-95e8-105f9eeaa194 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.541078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d9092-8549-4b61-95e8-105f9eeaa194 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.541078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d9092-8549-4b61-95e8-105f9eeaa194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.577043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5a7d9092-8549-4b61-95e8-105f9eeaa194 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:21.577043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5a7d9092-8549-4b61-95e8-105f9eeaa194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:21.577600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.577600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.580773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.581186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.583295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:21.622163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:21.631956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:21.650126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 842/1660] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:21.652055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af817-8729-461f-a8aa-ddc7e19e97b2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.652371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af817-8729-461f-a8aa-ddc7e19e97b2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.653413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af817-8729-461f-a8aa-ddc7e19e97b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.676492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8a3af817-8729-461f-a8aa-ddc7e19e97b2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:21.677757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8a3af817-8729-461f-a8aa-ddc7e19e97b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:21.680060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.681517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.686038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 843/1661] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:21.690141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af817-8729-461f-a8aa-ddc7e19e97b2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.691679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 819/1662] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:21.699260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af817-8729-461f-a8aa-ddc7e19e97b2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.704172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.704776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.705097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.705369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.706013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:21.706313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.707910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.720338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 844/1663] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:12:21.724691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.735453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869919-c240-4d58-b1f2-0b2a64177b13 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.740629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.741287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.741566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.741836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.742492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.744650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.782173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 820/1664] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:21 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:21.786906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.798866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcfeb-5ccb-4953-9baf-4042403bc554 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.867580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.868241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.868524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.868792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.869481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.871435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.893785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 845/1665] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:21 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:21.897991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.910960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7628d-c26e-4835-9192-680e1908f096 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.916395 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.917162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.917352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.917576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.918219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.919810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.932505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 821/1666] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:21.936323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.946962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5c019-5f32-4c6d-9fec-8506423b4417 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.951880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.960128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.960128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.960380 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:21.961117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:21.962799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:21.975421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 846/1667] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:21.979410 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:21.991599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b440b-f137-45fc-8ab6-dc496a56c10c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:21.997353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eaf26-ba2e-4199-9ea7-e2195b4b94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:21.998217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaf26-ba2e-4199-9ea7-e2195b4b94e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:21.998571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaf26-ba2e-4199-9ea7-e2195b4b94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:21.998761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaf26-ba2e-4199-9ea7-e2195b4b94e6 admin admin] PATH_INFO: `/v3/projects/f7f102e064b14d5ea0dc89109f608db6/users/3f4f1b6d841b4c81ae0a94ed7804b0f9/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.009559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:22.011517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.022619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaf26-ba2e-4199-9ea7-e2195b4b94e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f102e064b14d5ea0dc89109f608db6, user_id=3f4f1b6d841b4c81ae0a94ed7804b0f9, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:22.025973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaf26-ba2e-4199-9ea7-e2195b4b94e6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:22.026763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007db8-b444-4a77-915a-817971bbbcec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:22.041480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:22.045856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 822/1668] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:21 2022] PUT /identity/v3/projects/f7f102e064b14d5ea0dc89109f608db6/users/3f4f1b6d841b4c81ae0a94ed7804b0f9/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:22.046270 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:22.046270 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:22.046508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] PATH_INFO: `/v3/projects/1b36b0110a564ad983f7988a3be6a421` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.047990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b36b0110a564ad983f7988a3be6a421)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:22.050509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:22.050788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:22.051040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.051491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:22.073665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:22.074952 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.124735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b36b0110a564ad983f7988a3be6a421', 'request_id': 'req-005e00a5-4407-46be-a638-686b756acf81'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.134210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b36b0110a564ad983f7988a3be6a421', 'request_id': 'req-005e00a5-4407-46be-a638-686b756acf81'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.143352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b36b0110a564ad983f7988a3be6a421', 'request_id': 'req-005e00a5-4407-46be-a638-686b756acf81'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.155967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] The token cache is being invalidate because project 1b36b0110a564ad983f7988a3be6a421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:22.157052 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.157823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.159669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 847/1669] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:22 2022] DELETE /identity/v3/projects/1b36b0110a564ad983f7988a3be6a421 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:22.160637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:22.162105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.172311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 823/1670] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:22.173914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:22.178162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.191686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd622d-0e4f-4805-8677-a3d230a3993b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:22.213940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:22.227786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e00a5-4407-46be-a638-686b756acf81 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:22.231527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:22.232137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:22.232420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:22.232696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.234517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.256859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:22.257554 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:22.257834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:22.258109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] PATH_INFO: `/v3/users/f4fd533e03b54160b7667458d5963759` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.259244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fd533e03b54160b7667458d5963759)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:22.261197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:22.272060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:22.295994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:22.297562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:22.306902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 848/1671] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:22.307645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:22.308954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.310164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fd533e03b54160b7667458d5963759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.310897 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fd533e03b54160b7667458d5963759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.320072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fd533e03b54160b7667458d5963759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.320739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fd533e03b54160b7667458d5963759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.336371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fd533e03b54160b7667458d5963759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.350715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 824/1672] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:22 2022] DELETE /identity/v3/users/f4fd533e03b54160b7667458d5963759 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:22.370861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236caf4f-6609-4aac-91ec-52744cdf52c6 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:22.433782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3e80c-bfbe-46e7-8326-41eea2db7929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:22.434778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e80c-bfbe-46e7-8326-41eea2db7929 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:22.435483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e80c-bfbe-46e7-8326-41eea2db7929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:22.435913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e80c-bfbe-46e7-8326-41eea2db7929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.438620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fff3e80c-bfbe-46e7-8326-41eea2db7929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.513518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3e80c-bfbe-46e7-8326-41eea2db7929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:22.515227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3e80c-bfbe-46e7-8326-41eea2db7929 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:22.528479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 849/1673] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:22.691801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:22.693234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:22.718261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ec44-6e71-42dd-be4b-1bbd9fa9e43b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:22.729914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:22.730644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:22.731387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:22.731387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] PATH_INFO: `/v3/projects/e79daf85165243fda6dde19b1c745237` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.735696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79daf85165243fda6dde19b1c745237)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:22.739230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:22.872738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79daf85165243fda6dde19b1c745237', 'request_id': 'req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.883498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79daf85165243fda6dde19b1c745237', 'request_id': 'req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.893525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79daf85165243fda6dde19b1c745237', 'request_id': 'req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.913680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] The token cache is being invalidate because project e79daf85165243fda6dde19b1c745237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:22.913971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.914884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:22.920083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 825/1674] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:22 2022] DELETE /identity/v3/projects/e79daf85165243fda6dde19b1c745237 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:22.921467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675b5e-bb48-4637-b68e-a0de8f8b6ad9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:22.921763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675b5e-bb48-4637-b68e-a0de8f8b6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:22.922677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675b5e-bb48-4637-b68e-a0de8f8b6ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:22.937519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:22.959043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e5675b5e-bb48-4637-b68e-a0de8f8b6ad9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:22.963294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5675b5e-bb48-4637-b68e-a0de8f8b6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:23.078959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.080747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:23.089026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 850/1675] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:23.095371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42062-a49b-4f74-80be-c643a5a91a34 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.095651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42062-a49b-4f74-80be-c643a5a91a34 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.095927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42062-a49b-4f74-80be-c643a5a91a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.132924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f6b42062-a49b-4f74-80be-c643a5a91a34 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:23.134718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f6b42062-a49b-4f74-80be-c643a5a91a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:23.145039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 851/1676] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:23.149624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42062-a49b-4f74-80be-c643a5a91a34 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.167138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42062-a49b-4f74-80be-c643a5a91a34 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.176489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.177692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.177959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.178841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.179923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:23.180480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.182525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.186985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17248-e9b6-4dc2-b80a-8ca3d8d574cf admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.191241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.192015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.192434 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.192872 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.194841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:23.197470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 852/1677] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:12:23.202443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.216546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509325c-6045-4ad1-9812-474330a1d38c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.225643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.226489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.226866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.227792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.228535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.230204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:23.232329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.273469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 853/1678] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:23.278051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.287227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.289015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.302606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 826/1679] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:23.377011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3185428-ad5a-497f-aa4c-08b0c0759db1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.383358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7555a-0f57-406e-8212-2a9b7e33d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.384087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7555a-0f57-406e-8212-2a9b7e33d52e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.384381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7555a-0f57-406e-8212-2a9b7e33d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.384656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7555a-0f57-406e-8212-2a9b7e33d52e admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.385544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7555a-0f57-406e-8212-2a9b7e33d52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.388607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7555a-0f57-406e-8212-2a9b7e33d52e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.429194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 854/1680] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:23.432768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.447066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616407-e2ea-4007-8acc-7074c76431d5 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.462287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.462579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.462858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.474999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.475628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.475910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.476185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.485770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.485770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.494663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 827/1681] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:23.499847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.510974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971ce7-2330-42b4-8628-33f553954667 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.513978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] MFA Rules not processed for user `3f4f1b6d841b4c81ae0a94ed7804b0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:23.515225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:23.517408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.518034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.518879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.519318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.520086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.522064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.536421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 828/1682] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:23.540839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.564275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f9f6e-50db-4cb6-a08e-f872418796e8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.568535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:23.572358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a16a72-e7d1-44a2-b54f-46887ed17e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.574004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16a72-e7d1-44a2-b54f-46887ed17e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.574301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16a72-e7d1-44a2-b54f-46887ed17e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.574587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16a72-e7d1-44a2-b54f-46887ed17e74 admin admin] PATH_INFO: `/v3/projects/3123d07aa3db4f99aa90748d5050b79d/users/def1aa7c557f41ae861183447da8800f/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.595103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a16a72-e7d1-44a2-b54f-46887ed17e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3123d07aa3db4f99aa90748d5050b79d, user_id=def1aa7c557f41ae861183447da8800f, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.598002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a16a72-e7d1-44a2-b54f-46887ed17e74 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.608026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 855/1683] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:23.612687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.614825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:23.626465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 829/1684] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:23 2022] PUT /identity/v3/projects/3123d07aa3db4f99aa90748d5050b79d/users/def1aa7c557f41ae861183447da8800f/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:23.628166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8845-7d9f-4fc3-8b4a-1d796e0634f2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.628531 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8845-7d9f-4fc3-8b4a-1d796e0634f2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.629061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8845-7d9f-4fc3-8b4a-1d796e0634f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.644558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae8084-fe9f-4af8-93ca-8f4e28cb9e6b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.669956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fdca8845-7d9f-4fc3-8b4a-1d796e0634f2 None None] MFA Rules not processed for user `def1aa7c557f41ae861183447da8800f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:23.671756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fdca8845-7d9f-4fc3-8b4a-1d796e0634f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:23.731580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.732483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.733098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.733514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.734316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.736470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.759978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 830/1685] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:23.764761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8845-7d9f-4fc3-8b4a-1d796e0634f2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.775185 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 856/1686] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:23.777304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8845-7d9f-4fc3-8b4a-1d796e0634f2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.778837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.847253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcf36d-2989-4298-9dc3-f999dd5d3643 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.848580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.849458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.850713 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.851320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.852620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.853043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.853511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.853594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.853864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.854505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.856198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.856521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.871492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:23.886757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 857/1687] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:23.888861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.900295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 831/1688] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:23.902116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee6b7-59df-4905-9012-f525763be8e9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.909124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:23.964694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:23.974273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.975526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.975886 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.976230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.977782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.979581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:23.986684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb7067-b135-40e4-95da-6bc9037b433f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:23.992378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:23.993179 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:23.993576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:23.993854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:23.994633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:23.994992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 858/1689] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:23.999135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.000310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.014341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a2d37-c133-4e4f-ba42-a06d22c1d653 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.020840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.021609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.021870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.022147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] PATH_INFO: `/v3/projects/82a64fd602c94c45b3c455d4da4ce6f4/users/61530be8e6c9490984f487ea5dbd1378/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.035895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 832/1690] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:23 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:24.039802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.044202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a64fd602c94c45b3c455d4da4ce6f4, user_id=61530be8e6c9490984f487ea5dbd1378, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.047826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.053048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f4569-220b-4fe9-952d-2811c5b5f88d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.061129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.062159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.062628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.063292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.064437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.066749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.069710 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 859/1691] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:23 2022] PUT /identity/v3/projects/82a64fd602c94c45b3c455d4da4ce6f4/users/61530be8e6c9490984f487ea5dbd1378/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:24.073890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.082333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 833/1692] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:24.084064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.095411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adfa66-deb5-4ade-9ebf-32ac860c099a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.144543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1282b9a-1440-41f3-8246-9befdc6dca49 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.149939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.151099 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.151498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.151775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.152430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.154094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.163551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.164727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.165154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.165524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.166080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 860/1693] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:24.166596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.168226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.174022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.180134 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 834/1694] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:24.184264 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.186007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026405-13e4-4f5f-a5c0-fcbcc96ecea7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.191988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6909a-56a1-4594-a285-52590de52b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.192679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6909a-56a1-4594-a285-52590de52b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.192961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6909a-56a1-4594-a285-52590de52b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.193274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6909a-56a1-4594-a285-52590de52b66 admin admin] PATH_INFO: `/v3/projects/82a64fd602c94c45b3c455d4da4ce6f4/users/61530be8e6c9490984f487ea5dbd1378/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.195243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6909a-56a1-4594-a285-52590de52b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a64fd602c94c45b3c455d4da4ce6f4, user_id=61530be8e6c9490984f487ea5dbd1378, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.195575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977371-23ae-4188-9948-8072b0e11915 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.198014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6909a-56a1-4594-a285-52590de52b66 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.200645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.201541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.202115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.202476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] PATH_INFO: `/v3/projects/cfaca36cf9da4334afda985f314bd988/users/efe2ec2fd9634631a208165ad10019f2/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.209572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 861/1695] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:24 2022] PUT /identity/v3/projects/82a64fd602c94c45b3c455d4da4ce6f4/users/61530be8e6c9490984f487ea5dbd1378/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:24.220146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfaca36cf9da4334afda985f314bd988, user_id=efe2ec2fd9634631a208165ad10019f2, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.223237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.241057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 835/1696] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:24 2022] PUT /identity/v3/projects/cfaca36cf9da4334afda985f314bd988/users/efe2ec2fd9634631a208165ad10019f2/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:24.250688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389d581-187a-4f45-8504-2a6fe4196dd2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.251179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389d581-187a-4f45-8504-2a6fe4196dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.251258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389d581-187a-4f45-8504-2a6fe4196dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.282516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d389d581-187a-4f45-8504-2a6fe4196dd2 None None] MFA Rules not processed for user `efe2ec2fd9634631a208165ad10019f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:24.283755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d389d581-187a-4f45-8504-2a6fe4196dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:24.366580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 862/1697] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:24.367727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.429103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:24.464244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d3039-34d4-496a-9d92-bb8897267d02 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.477057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.477964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.478245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.478519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.479159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.481222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.523348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 836/1698] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:24 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:24.524855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389d581-187a-4f45-8504-2a6fe4196dd2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.539352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389d581-187a-4f45-8504-2a6fe4196dd2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.593272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:24.619351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.620571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.620866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.621210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.621860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.624460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.676368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 863/1699] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:24 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:24.680595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.692992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03b3e-3a34-4b37-b1e2-6bc2443856af admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.698285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.699791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.700320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.700859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.701963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.704532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.720004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 837/1700] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:24.721598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.738160 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f0233-142d-40d5-807c-44782ad5882a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.744068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.744876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.745280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.745650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] PATH_INFO: `/v3/projects/6eefb27153e344c08aec5faa084e22a6/users/c0445036c741437c8bb169c45531c0b2/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.764910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eefb27153e344c08aec5faa084e22a6, user_id=c0445036c741437c8bb169c45531c0b2, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.768758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.794378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 864/1701] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:24 2022] PUT /identity/v3/projects/6eefb27153e344c08aec5faa084e22a6/users/c0445036c741437c8bb169c45531c0b2/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:24.798546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.815452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd04f2-898d-49b0-a479-d4d12879f589 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:24.940014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047490-be4d-4fc8-bcc7-5f4c18afdbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:24.940758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047490-be4d-4fc8-bcc7-5f4c18afdbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:24.941176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047490-be4d-4fc8-bcc7-5f4c18afdbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:24.941574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047490-be4d-4fc8-bcc7-5f4c18afdbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:24.942484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047490-be4d-4fc8-bcc7-5f4c18afdbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:24.946054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047490-be4d-4fc8-bcc7-5f4c18afdbd7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:24.967503 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 838/1702] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:24.970144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:24.999177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e15a-60e1-4c64-bb34-d90c045ae3e3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:25.024474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cc891-9c3d-4464-955f-3da306400774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:25.025285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc891-9c3d-4464-955f-3da306400774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:25.025474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc891-9c3d-4464-955f-3da306400774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:25.025749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc891-9c3d-4464-955f-3da306400774 admin admin] PATH_INFO: `/v3/projects/6eefb27153e344c08aec5faa084e22a6/users/c0445036c741437c8bb169c45531c0b2/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:25.032175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cc891-9c3d-4464-955f-3da306400774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eefb27153e344c08aec5faa084e22a6, user_id=c0445036c741437c8bb169c45531c0b2, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:25.035120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cc891-9c3d-4464-955f-3da306400774 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:25.063072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 865/1703] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:24 2022] PUT /identity/v3/projects/6eefb27153e344c08aec5faa084e22a6/users/c0445036c741437c8bb169c45531c0b2/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:25.145666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:25.145958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:25.146237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:25.191643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] MFA Rules not processed for user `c0445036c741437c8bb169c45531c0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:25.195238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:25.276668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c76448-3b1a-4b43-88c7-e613773b3ac4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:25.277249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c76448-3b1a-4b43-88c7-e613773b3ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:25.277473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c76448-3b1a-4b43-88c7-e613773b3ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:25.320304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e9c76448-3b1a-4b43-88c7-e613773b3ac4 None None] MFA Rules not processed for user `61530be8e6c9490984f487ea5dbd1378`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:25.322487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e9c76448-3b1a-4b43-88c7-e613773b3ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:25.334243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 839/1704] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:25.344357 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:25.346229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:25.423552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:25.460682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 866/1705] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:25.476323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:25.476623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:25.476876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:25.504236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f78ff5-fcf1-4f93-9d38-1ff38213346c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:25.513349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:25.514013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:25.514329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:25.515111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:25.516383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] MFA Rules not processed for user `3f4f1b6d841b4c81ae0a94ed7804b0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:25.517293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:25.609774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:25.611482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:25.617277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 867/1706] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:25.631858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 840/1707] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:25.641799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:25.643605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:25.684613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:25.767744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc8f0f-6030-4ae3-b85b-9a7463228150 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:25.775938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:25.776776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:25.777255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:25.777708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:25.788428 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:25.790862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:25.805353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 868/1708] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:27.540262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:27.551461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca143-e055-4017-b0d0-e36fb6112896 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:27.558922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:27.565000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:27.565338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:27.567158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:27.655005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:27.656885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:27.689299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 841/1709] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:27.903896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:27.911592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:27.922866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:27.924709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.056296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910962c9-af36-413b-aedc-89778b8ca316 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.066377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.067510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.067945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.068769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] PATH_INFO: `/v3/users/9b39b03c3c124a38a6ef8b162af9a127` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.069919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b39b03c3c124a38a6ef8b162af9a127)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.072769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.092129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e946b-b481-4d76-bf68-94cffbd9435a service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.105658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.106242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.106500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.106846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] PATH_INFO: `/v3/users/0037e6edc2b440b887597aa419540efb` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.109560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0037e6edc2b440b887597aa419540efb)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.111798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.164679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b39b03c3c124a38a6ef8b162af9a127'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.165616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:28.177494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b39b03c3c124a38a6ef8b162af9a127'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.178258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b39b03c3c124a38a6ef8b162af9a127'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.178867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b39b03c3c124a38a6ef8b162af9a127'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.184086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0037e6edc2b440b887597aa419540efb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.185081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0037e6edc2b440b887597aa419540efb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.193567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1355e14a-cdc2-4f27-a843-9c56124d244a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b39b03c3c124a38a6ef8b162af9a127'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.197022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0037e6edc2b440b887597aa419540efb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.197642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0037e6edc2b440b887597aa419540efb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.213845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 869/1710] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:27 2022] DELETE /identity/v3/users/9b39b03c3c124a38a6ef8b162af9a127 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:28.216061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0037e6edc2b440b887597aa419540efb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.219473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.220149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.220542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.237112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 842/1711] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:27 2022] DELETE /identity/v3/users/0037e6edc2b440b887597aa419540efb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:28.242398 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:28.243676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.270922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:28.335423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 870/1712] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:28.345489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:28.347246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.425176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2ce9-0e33-40df-ab2d-e8374a725d0c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.429527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.430224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.430545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.430820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.441317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.442920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.444502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:28.446636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.471426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 843/1713] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:28.478889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e27892-42db-4ff1-a512-ad0cfac89daa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.486203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.486893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.487120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.487400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] PATH_INFO: `/v3/projects/feeb266c13fc4c01a3a07618d7b1625b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.489287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feeb266c13fc4c01a3a07618d7b1625b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.491372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.514440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:28.515893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.555771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feeb266c13fc4c01a3a07618d7b1625b', 'request_id': 'req-97916b3d-e291-48c5-aa1d-35b4ce43f341'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.566903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feeb266c13fc4c01a3a07618d7b1625b', 'request_id': 'req-97916b3d-e291-48c5-aa1d-35b4ce43f341'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.574885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feeb266c13fc4c01a3a07618d7b1625b', 'request_id': 'req-97916b3d-e291-48c5-aa1d-35b4ce43f341'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.588360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] The token cache is being invalidate because project feeb266c13fc4c01a3a07618d7b1625b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:28.588654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.589350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-97916b3d-e291-48c5-aa1d-35b4ce43f341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:28.593085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 871/1714] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:28 2022] DELETE /identity/v3/projects/feeb266c13fc4c01a3a07618d7b1625b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:28.598800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b395ee-1e45-4f89-bfef-d4900ff43ee4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.599135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b395ee-1e45-4f89-bfef-d4900ff43ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.599429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b395ee-1e45-4f89-bfef-d4900ff43ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.604071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96dd4b-1ff8-4885-87fd-5b99f5ea01d6 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.629442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b7b395ee-1e45-4f89-bfef-d4900ff43ee4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:28.633707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b7b395ee-1e45-4f89-bfef-d4900ff43ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.672623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.673679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.674247 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.674757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.677132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.729589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:28.765016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 872/1715] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:28.769870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41474d5-25c4-4653-81f6-a4ce42c1d9b6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.770157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41474d5-25c4-4653-81f6-a4ce42c1d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.770430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41474d5-25c4-4653-81f6-a4ce42c1d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.794066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.795569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.806228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f41474d5-25c4-4653-81f6-a4ce42c1d9b6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:28.807466 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 844/1716] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:28.808124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f41474d5-25c4-4653-81f6-a4ce42c1d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.817257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 873/1717] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:28.822204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:28.834623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1b01-4e42-43c4-bc33-bdf993c2e8d9 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.842276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.845571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.846126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.846566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.847370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:28.847834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.850989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.871847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 845/1718] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:12:28.874152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41474d5-25c4-4653-81f6-a4ce42c1d9b6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:28.884660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41474d5-25c4-4653-81f6-a4ce42c1d9b6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.890252 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.891693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.892168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.892508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.893827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.895617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.901275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:28.903425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:28.925010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a3947-6359-44c7-8dc8-5863ed9f59ca admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:28.936938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:28.939192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:28.939658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:28.939975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] PATH_INFO: `/v3/projects/0033cf99df3443cfa354e056fe28840f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:28.941865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0033cf99df3443cfa354e056fe28840f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:28.946333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:28.960227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 874/1719] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:28 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:28.964427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:28.992764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:29.020062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0033cf99df3443cfa354e056fe28840f', 'request_id': 'req-e83bb3be-7458-4dca-8b26-cadeff059df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.027406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0033cf99df3443cfa354e056fe28840f', 'request_id': 'req-e83bb3be-7458-4dca-8b26-cadeff059df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.039349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0033cf99df3443cfa354e056fe28840f', 'request_id': 'req-e83bb3be-7458-4dca-8b26-cadeff059df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.039490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b932620-3f58-4b2d-99e5-88dea01c00b3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.054147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] The token cache is being invalidate because project 0033cf99df3443cfa354e056fe28840f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:29.055126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.056139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.058910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 846/1720] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:28 2022] DELETE /identity/v3/projects/0033cf99df3443cfa354e056fe28840f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:29.063491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.065415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:29.133184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.133962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.134316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.134805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.135594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.137616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.175426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bb3be-7458-4dca-8b26-cadeff059df9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.177935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 875/1721] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:28 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:29.181705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.183461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:29.184884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.185645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.185970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.186353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] PATH_INFO: `/v3/users/6e79449b50e24c6ba6d66d36987041d9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.188196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e79449b50e24c6ba6d66d36987041d9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.190752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.197790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95517058-01a6-421b-b8b9-19f151d631b3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.203795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.204412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.204697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.204967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.205658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.207293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.220094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 876/1722] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:29.225415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.232473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:29.236270 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dd9e9-9d0b-4802-b590-84b6cc3ec472 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.241239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.241854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.242138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.242417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.243091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.244694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.259478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 877/1723] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:29.260709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.262332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e79449b50e24c6ba6d66d36987041d9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.263178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e79449b50e24c6ba6d66d36987041d9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.271166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed484264-5f15-492c-aa9c-5b8bf24831bd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.274176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e79449b50e24c6ba6d66d36987041d9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.275037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e79449b50e24c6ba6d66d36987041d9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.276810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.277514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.277794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.278069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] PATH_INFO: `/v3/projects/82b05250302044cb9c901b3b3a0c700a/users/8969914445b247c0a8eb734e61fbbe99/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.290191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef4db727-5ab1-44aa-8c06-17ebccc42849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e79449b50e24c6ba6d66d36987041d9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.293701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b05250302044cb9c901b3b3a0c700a, user_id=8969914445b247c0a8eb734e61fbbe99, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.296392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.306745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 847/1724] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:29 2022] DELETE /identity/v3/users/6e79449b50e24c6ba6d66d36987041d9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:29.323043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 878/1725] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:29 2022] PUT /identity/v3/projects/82b05250302044cb9c901b3b3a0c700a/users/8969914445b247c0a8eb734e61fbbe99/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:29.334832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487f80-1445-437c-8e7e-767417ad5c39 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.335120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487f80-1445-437c-8e7e-767417ad5c39 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.335542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487f80-1445-437c-8e7e-767417ad5c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.371367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e4487f80-1445-437c-8e7e-767417ad5c39 None None] MFA Rules not processed for user `8969914445b247c0a8eb734e61fbbe99`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:29.372688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4487f80-1445-437c-8e7e-767417ad5c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:29.455491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 848/1726] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:29.459552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.461525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:29.536817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c4294-d988-4a8b-a0f5-6731c9a82505 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.542176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.542792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.543399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.543399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.544014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.545988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.569689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:29.589740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 879/1727] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:29 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:29.590996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487f80-1445-437c-8e7e-767417ad5c39 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.603828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487f80-1445-437c-8e7e-767417ad5c39 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.673414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.674151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.674496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.675132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.675568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.677696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.704188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 849/1728] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:29 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:29.707261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.721075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79248c-dbe6-445a-8161-6916cce15860 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.727280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.728359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.728750 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.729203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.730269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.730734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.732017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:29.732793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.746806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391253d-81ee-4c64-b100-4757e6e9d0af admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.752215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.752878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.753193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.753467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] PATH_INFO: `/v3/projects/8d57a2f447d6443a813bcd9027d234b1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.755030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d57a2f447d6443a813bcd9027d234b1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.756636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 880/1729] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:29.757162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.760035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.772474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116388a-ad03-4a1b-823b-af7bbfe39d66 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.777442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.778127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.778411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.778686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] PATH_INFO: `/v3/projects/932743672f56494985cb8e2a5ff25256/users/82cae650fa3b4e26b161d95f4aa64179/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.786292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:29.796106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932743672f56494985cb8e2a5ff25256, user_id=82cae650fa3b4e26b161d95f4aa64179, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.799969 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.818088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 881/1730] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:29 2022] PUT /identity/v3/projects/932743672f56494985cb8e2a5ff25256/users/82cae650fa3b4e26b161d95f4aa64179/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:29.821883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.826092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d57a2f447d6443a813bcd9027d234b1', 'request_id': 'req-cf86044a-2694-4274-8a8f-529a589c509e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.834218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d57a2f447d6443a813bcd9027d234b1', 'request_id': 'req-cf86044a-2694-4274-8a8f-529a589c509e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.842767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d57a2f447d6443a813bcd9027d234b1', 'request_id': 'req-cf86044a-2694-4274-8a8f-529a589c509e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.856505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] The token cache is being invalidate because project 8d57a2f447d6443a813bcd9027d234b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:29.856799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.857492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:29.859012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 850/1731] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:29 2022] DELETE /identity/v3/projects/8d57a2f447d6443a813bcd9027d234b1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:29.863530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.865955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:29.894383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aeda2-9845-4d97-b43a-fd5e633faa46 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.899942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.900563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.900854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.901179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.902773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.903826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.915769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 882/1732] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:29.919899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:29.922331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:29.935313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf982d6d-0938-4571-ac28-c82b89de2e1a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.935839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86044a-2694-4274-8a8f-529a589c509e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:29.940188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b10404-c620-4249-8ce5-3b781339eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.940483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:29.941084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10404-c620-4249-8ce5-3b781339eedf admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.941181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.941414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.941625 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10404-c620-4249-8ce5-3b781339eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.941718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] PATH_INFO: `/v3/users/736c2646767543e79877ba1c548b92b4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.942072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b10404-c620-4249-8ce5-3b781339eedf admin admin] PATH_INFO: `/v3/projects/932743672f56494985cb8e2a5ff25256/users/82cae650fa3b4e26b161d95f4aa64179/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:29.942850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736c2646767543e79877ba1c548b92b4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.944237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b10404-c620-4249-8ce5-3b781339eedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=932743672f56494985cb8e2a5ff25256, user_id=82cae650fa3b4e26b161d95f4aa64179, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:29.944751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.947469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b10404-c620-4249-8ce5-3b781339eedf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:29.958826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 883/1733] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:29 2022] PUT /identity/v3/projects/932743672f56494985cb8e2a5ff25256/users/82cae650fa3b4e26b161d95f4aa64179/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:29.971243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:29.971862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:29.971862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.014418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] MFA Rules not processed for user `82cae650fa3b4e26b161d95f4aa64179`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:30.015457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736c2646767543e79877ba1c548b92b4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.016096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.016355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736c2646767543e79877ba1c548b92b4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.026449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736c2646767543e79877ba1c548b92b4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.028077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736c2646767543e79877ba1c548b92b4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.044760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736c2646767543e79877ba1c548b92b4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.060449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 851/1734] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:29 2022] DELETE /identity/v3/users/736c2646767543e79877ba1c548b92b4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:30.111595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 884/1735] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:30.122957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:30.124461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.173208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:30.215685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978187-7f23-43ad-a80e-90f77ddcbee1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:30.222766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb498-d8dc-4c51-b883-e7a7988933ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:30.223456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb498-d8dc-4c51-b883-e7a7988933ce service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:30.223738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb498-d8dc-4c51-b883-e7a7988933ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:30.224010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb498-d8dc-4c51-b883-e7a7988933ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.226965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-839cb498-d8dc-4c51-b883-e7a7988933ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.318562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb498-d8dc-4c51-b883-e7a7988933ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:30.320533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb498-d8dc-4c51-b883-e7a7988933ce service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:30.333358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 852/1736] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:30.443617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:30.445157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.541429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:30.588437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15c22e-06af-477e-b3f7-dccd6356b6c1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:30.660438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:30.661288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:30.661691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:30.662072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] PATH_INFO: `/v3/projects/7ffc2e62be3d4ab8b6897089ef70c3ed` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.663419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffc2e62be3d4ab8b6897089ef70c3ed)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:30.665576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:30.749332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffc2e62be3d4ab8b6897089ef70c3ed', 'request_id': 'req-654ee386-6017-47f8-be01-836ba062ac94'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.779329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffc2e62be3d4ab8b6897089ef70c3ed', 'request_id': 'req-654ee386-6017-47f8-be01-836ba062ac94'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.784716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffc2e62be3d4ab8b6897089ef70c3ed', 'request_id': 'req-654ee386-6017-47f8-be01-836ba062ac94'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.803137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] The token cache is being invalidate because project 7ffc2e62be3d4ab8b6897089ef70c3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:30.803444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.804221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-654ee386-6017-47f8-be01-836ba062ac94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:30.806842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 885/1737] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:30 2022] DELETE /identity/v3/projects/7ffc2e62be3d4ab8b6897089ef70c3ed => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:30.812808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4902-f678-4265-85f6-9d926b266fee None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:30.813409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4902-f678-4265-85f6-9d926b266fee None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:30.813803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4902-f678-4265-85f6-9d926b266fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.838776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0e9f4902-f678-4265-85f6-9d926b266fee None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:30.840002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e9f4902-f678-4265-85f6-9d926b266fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.905091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 853/1738] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:30.914811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee542ad-c16e-4bd8-8194-e9babd156745 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:30.915101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee542ad-c16e-4bd8-8194-e9babd156745 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:30.915372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee542ad-c16e-4bd8-8194-e9babd156745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.935361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5ee542ad-c16e-4bd8-8194-e9babd156745 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:30.936582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5ee542ad-c16e-4bd8-8194-e9babd156745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.944992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 886/1739] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:30.949363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4902-f678-4265-85f6-9d926b266fee None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:30.959847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4902-f678-4265-85f6-9d926b266fee None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:30.964512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:30.965167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:30.965447 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:30.965717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.966361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:30.966665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:30.968244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:30.980227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 854/1740] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:12:30.985304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee542ad-c16e-4bd8-8194-e9babd156745 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:30.995140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee542ad-c16e-4bd8-8194-e9babd156745 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:31.000605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:31.001251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:31.001531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:31.001804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:31.002441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:31.004345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:31.032359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 887/1741] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:30 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:31.036486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:31.047519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bda26c-fca7-4da5-bed4-7b5318eb0293 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:31.107067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:31.107769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:31.108113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:31.108453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:31.109829 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:31.111821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:31.130315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:31.137720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 855/1742] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:31 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:31.141430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:31.151771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d88b7a-5a71-41ea-8d41-6c825fe94352 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:31.156505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:31.157142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:31.157426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:31.157698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:31.158344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:31.159946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:31.170246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 888/1743] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:31.174753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:31.184859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa0d7-4ca3-4d1a-81b8-a6b2c5d3fd2c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:31.190279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62314998-9b32-40fd-9e35-106b1aa5eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:31.190900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314998-9b32-40fd-9e35-106b1aa5eac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:31.191183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314998-9b32-40fd-9e35-106b1aa5eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:31.191455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314998-9b32-40fd-9e35-106b1aa5eac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:31.192096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62314998-9b32-40fd-9e35-106b1aa5eac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:31.193777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62314998-9b32-40fd-9e35-106b1aa5eac6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:31.205866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 856/1744] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:31.209996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:31.220207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241838-c058-4467-82d8-30a74a324de7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:31.225467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:31.226209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:31.226511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:31.226875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] PATH_INFO: `/v3/projects/bce07244103d4861995e6074ac0aa7bf/users/394a21d72dba4069b744d34495d5dee0/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:31.243888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce07244103d4861995e6074ac0aa7bf, user_id=394a21d72dba4069b744d34495d5dee0, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:31.246705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:31.260422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 889/1745] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:31 2022] PUT /identity/v3/projects/bce07244103d4861995e6074ac0aa7bf/users/394a21d72dba4069b744d34495d5dee0/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:31.270969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:31.271259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:31.271538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:31.301792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] MFA Rules not processed for user `394a21d72dba4069b744d34495d5dee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:31.302946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:31.369371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 857/1746] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:31.381467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:31.383185 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:31.389646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:31.442849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b85f3d-7f96-45e6-a626-ce31a34b32f7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:31.446700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:31.447303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:31.447579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:31.447849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:31.455830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:31.457276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:31.468459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 890/1747] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:33.002974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:33.006150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:33.106746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:33.108205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:33.108619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0f9b-3096-4822-8479-73fefcd74423 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:33.114582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:33.115314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:33.115666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:33.116019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] PATH_INFO: `/v3/users/def1aa7c557f41ae861183447da8800f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:33.117248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=def1aa7c557f41ae861183447da8800f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:33.122091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:33.127576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a2806-d58f-484f-a339-2d9a6e60abb5 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:33.131800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488934a6-7b18-4dcf-8170-cdb925c4136d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:33.132423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488934a6-7b18-4dcf-8170-cdb925c4136d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:33.132702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488934a6-7b18-4dcf-8170-cdb925c4136d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:33.132996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488934a6-7b18-4dcf-8170-cdb925c4136d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:33.134730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-488934a6-7b18-4dcf-8170-cdb925c4136d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:33.205417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def1aa7c557f41ae861183447da8800f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.206100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def1aa7c557f41ae861183447da8800f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.214381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def1aa7c557f41ae861183447da8800f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.215146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def1aa7c557f41ae861183447da8800f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.215820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488934a6-7b18-4dcf-8170-cdb925c4136d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:33.217623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488934a6-7b18-4dcf-8170-cdb925c4136d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:33.231664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 891/1748] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:33.244173 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def1aa7c557f41ae861183447da8800f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.251535 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:33.266749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 858/1749] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:33 2022] DELETE /identity/v3/users/def1aa7c557f41ae861183447da8800f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:33.268029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:33.268312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:33.268581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:33.288589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:33.290249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:33.365177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 892/1750] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:33.374785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:33.376214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:33.464619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c7e0f-95cb-477b-b8fe-af2ac3426b1c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:33.468352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:33.469604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:33.469890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:33.470158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:33.480530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:33.483475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:33.497587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 859/1751] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:12:33.772932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:33.774555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:33.787214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fddf5-d57a-4a0c-b3de-dbbe4eeeaf11 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:33.791831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:33.792471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:33.792776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:33.793079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] PATH_INFO: `/v3/projects/3123d07aa3db4f99aa90748d5050b79d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:33.794259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3123d07aa3db4f99aa90748d5050b79d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:33.796093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:33.836924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:33.847539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3123d07aa3db4f99aa90748d5050b79d', 'request_id': 'req-ba2e5293-e557-4c8c-a54c-2f1653190d3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.854641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3123d07aa3db4f99aa90748d5050b79d', 'request_id': 'req-ba2e5293-e557-4c8c-a54c-2f1653190d3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.860160 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3123d07aa3db4f99aa90748d5050b79d', 'request_id': 'req-ba2e5293-e557-4c8c-a54c-2f1653190d3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.871432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] The token cache is being invalidate because project 3123d07aa3db4f99aa90748d5050b79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:33.871656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.872295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:33.873861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 893/1752] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:33 2022] DELETE /identity/v3/projects/3123d07aa3db4f99aa90748d5050b79d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:33.878342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:33.888764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff74ee-97eb-496e-93a8-461919adf827 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:33.947860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:33.948526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:33.948802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:33.949104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] PATH_INFO: `/v3/users/efe2ec2fd9634631a208165ad10019f2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:33.950218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe2ec2fd9634631a208165ad10019f2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:33.952122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:34.003644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe2ec2fd9634631a208165ad10019f2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.004693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe2ec2fd9634631a208165ad10019f2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.014819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe2ec2fd9634631a208165ad10019f2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.015480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe2ec2fd9634631a208165ad10019f2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.028685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe2ec2fd9634631a208165ad10019f2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.043341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 860/1753] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:33 2022] DELETE /identity/v3/users/efe2ec2fd9634631a208165ad10019f2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:34.334317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:34.337329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:34.361074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5293-e557-4c8c-a54c-2f1653190d3d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:34.434848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:34.435496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:34.435769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:34.436040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] PATH_INFO: `/v3/projects/cfaca36cf9da4334afda985f314bd988` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:34.437356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfaca36cf9da4334afda985f314bd988)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:34.439484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:34.491813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfaca36cf9da4334afda985f314bd988', 'request_id': 'req-04845588-5455-4303-a0de-716090a29a04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.513176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfaca36cf9da4334afda985f314bd988', 'request_id': 'req-04845588-5455-4303-a0de-716090a29a04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.527857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfaca36cf9da4334afda985f314bd988', 'request_id': 'req-04845588-5455-4303-a0de-716090a29a04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.543152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] The token cache is being invalidate because project cfaca36cf9da4334afda985f314bd988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:34.543152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.543832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.554558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 894/1754] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:34 2022] DELETE /identity/v3/projects/cfaca36cf9da4334afda985f314bd988 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:34.555846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:34.557588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:34.570584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376aa25-4f44-4496-8c2e-9f4b21772670 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:34.590353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:34.645926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:34.646666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:34.647033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:34.647373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] PATH_INFO: `/v3/users/c0445036c741437c8bb169c45531c0b2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:34.648965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0445036c741437c8bb169c45531c0b2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:34.653117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:34.709975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0445036c741437c8bb169c45531c0b2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.710620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0445036c741437c8bb169c45531c0b2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.719357 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0445036c741437c8bb169c45531c0b2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.720057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0445036c741437c8bb169c45531c0b2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.733993 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0445036c741437c8bb169c45531c0b2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:34.752236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 861/1755] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:34 2022] DELETE /identity/v3/users/c0445036c741437c8bb169c45531c0b2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:35.024028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:35.025480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:35.039073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845588-5455-4303-a0de-716090a29a04 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:35.121592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:35.129082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:35.129711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:35.129992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:35.130284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] PATH_INFO: `/v3/projects/6eefb27153e344c08aec5faa084e22a6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:35.131667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eefb27153e344c08aec5faa084e22a6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:35.136235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:35.195063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eefb27153e344c08aec5faa084e22a6', 'request_id': 'req-0c15d986-9299-46fd-9aee-e19a058671c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:35.205001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eefb27153e344c08aec5faa084e22a6', 'request_id': 'req-0c15d986-9299-46fd-9aee-e19a058671c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:35.211640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eefb27153e344c08aec5faa084e22a6', 'request_id': 'req-0c15d986-9299-46fd-9aee-e19a058671c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:35.224278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] The token cache is being invalidate because project 6eefb27153e344c08aec5faa084e22a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:35.224571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:35.225274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:35.226798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 895/1756] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:35 2022] DELETE /identity/v3/projects/6eefb27153e344c08aec5faa084e22a6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:40.786959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:40.788366 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:40.851671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886ad3-f22c-4216-8d72-b2b306d7b1c2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:40.903232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0cca0-ea4f-4686-8669-3acce17ef022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:40.904049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cca0-ea4f-4686-8669-3acce17ef022 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:40.904326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cca0-ea4f-4686-8669-3acce17ef022 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:40.904595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cca0-ea4f-4686-8669-3acce17ef022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:40.906445 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-35c0cca0-ea4f-4686-8669-3acce17ef022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:40.913390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:40.976866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0cca0-ea4f-4686-8669-3acce17ef022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:40.978664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0cca0-ea4f-4686-8669-3acce17ef022 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:40.989079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 862/1757] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:45.220754 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:45.919730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:45.921228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:45.988351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d986-9299-46fd-9aee-e19a058671c8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:45.993118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:45.993786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:45.994062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:45.994332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] PATH_INFO: `/v3/users/8969914445b247c0a8eb734e61fbbe99` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:45.999671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8969914445b247c0a8eb734e61fbbe99)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:46.002271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:46.049610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8969914445b247c0a8eb734e61fbbe99'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.056574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8969914445b247c0a8eb734e61fbbe99'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.057271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8969914445b247c0a8eb734e61fbbe99'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.057891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8969914445b247c0a8eb734e61fbbe99'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.071260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8969914445b247c0a8eb734e61fbbe99'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.088739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 896/1758] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:45 2022] DELETE /identity/v3/users/8969914445b247c0a8eb734e61fbbe99 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:46.093249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:46.094214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:46.094674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:46.116451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:46.117730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:46.185478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 863/1759] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:46.196518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:46.198024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:46.258438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecec64c-9762-4020-8f5c-e66db56a2fbb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:46.263257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:46.263257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:46.263257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:46.263577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:46.273276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:46.274816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:46.284917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 897/1760] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:46.635787 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:46.637147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:46.651762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2ce0-7ce4-4450-a3ad-f445d7511059 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:46.656524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:46.657299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:46.657574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:46.657840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] PATH_INFO: `/v3/projects/82b05250302044cb9c901b3b3a0c700a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:46.659063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b05250302044cb9c901b3b3a0c700a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:46.661003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:46.713041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b05250302044cb9c901b3b3a0c700a', 'request_id': 'req-10d3b547-4305-425d-a075-1cb525e5787b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.718493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b05250302044cb9c901b3b3a0c700a', 'request_id': 'req-10d3b547-4305-425d-a075-1cb525e5787b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.726202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b05250302044cb9c901b3b3a0c700a', 'request_id': 'req-10d3b547-4305-425d-a075-1cb525e5787b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.738845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] The token cache is being invalidate because project 82b05250302044cb9c901b3b3a0c700a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:46.739139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.739785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.741477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 864/1761] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:46 2022] DELETE /identity/v3/projects/82b05250302044cb9c901b3b3a0c700a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:46.745609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:46.757330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec221e-d35a-439d-965b-b3424963f726 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:46.777329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:46.821373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:46.822160 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:46.822505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:46.822847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] PATH_INFO: `/v3/users/82cae650fa3b4e26b161d95f4aa64179` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:46.824068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cae650fa3b4e26b161d95f4aa64179)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:46.826062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:46.876178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cae650fa3b4e26b161d95f4aa64179'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.882863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cae650fa3b4e26b161d95f4aa64179'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.883567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cae650fa3b4e26b161d95f4aa64179'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.884207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cae650fa3b4e26b161d95f4aa64179'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.897067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-25336e62-dca6-4481-8812-1cdbd742cd43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cae650fa3b4e26b161d95f4aa64179'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:46.914406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 898/1762] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:46 2022] DELETE /identity/v3/users/82cae650fa3b4e26b161d95f4aa64179 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:47.218657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:47.221081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:47.237542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3b547-4305-425d-a075-1cb525e5787b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:47.263279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:47.301574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:47.302608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.303103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.303462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] PATH_INFO: `/v3/projects/932743672f56494985cb8e2a5ff25256` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.304587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=932743672f56494985cb8e2a5ff25256)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:47.306656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:47.354720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932743672f56494985cb8e2a5ff25256', 'request_id': 'req-f17a5646-59c6-43de-b584-4c224aed6d37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:47.360771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932743672f56494985cb8e2a5ff25256', 'request_id': 'req-f17a5646-59c6-43de-b584-4c224aed6d37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:47.368400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932743672f56494985cb8e2a5ff25256', 'request_id': 'req-f17a5646-59c6-43de-b584-4c224aed6d37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:47.381383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] The token cache is being invalidate because project 932743672f56494985cb8e2a5ff25256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:47.381676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:47.382373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f17a5646-59c6-43de-b584-4c224aed6d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:47.383894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 865/1763] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:47 2022] DELETE /identity/v3/projects/932743672f56494985cb8e2a5ff25256 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:47.389198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db618a1-c341-412a-8614-e3016c97dc44 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.389669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db618a1-c341-412a-8614-e3016c97dc44 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.389782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db618a1-c341-412a-8614-e3016c97dc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.410660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5db618a1-c341-412a-8614-e3016c97dc44 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:47.411904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5db618a1-c341-412a-8614-e3016c97dc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:47.479500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 899/1764] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:47.487054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72201e7b-b78e-4c44-ac85-34028daebb81 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.487340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72201e7b-b78e-4c44-ac85-34028daebb81 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.487637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72201e7b-b78e-4c44-ac85-34028daebb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.507403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-72201e7b-b78e-4c44-ac85-34028daebb81 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:47.508592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-72201e7b-b78e-4c44-ac85-34028daebb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:47.517046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 866/1765] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:12:47.521828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db618a1-c341-412a-8614-e3016c97dc44 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:47.533328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db618a1-c341-412a-8614-e3016c97dc44 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:47.538293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:47.538917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.539195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.539462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.540113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:47.540409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:47.542032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:47.554074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 900/1766] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:12:47.558125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72201e7b-b78e-4c44-ac85-34028daebb81 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:47.567323 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72201e7b-b78e-4c44-ac85-34028daebb81 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:47.572127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:47.572722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.573026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.573327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.573984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:47.575965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:47.611973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 867/1767] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:47 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:47.615966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:47.626377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900f9d-c02b-4fea-8e3a-a5992ac0287a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:47.657665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:47.697049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:47.697941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.698217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.698486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.699115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:47.701104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:47.724321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 901/1768] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:47 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:47.728837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:47.740316 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b950087-691a-4da4-89ac-dd3840543530 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:47.745051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:47.745701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.745984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.746256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.746894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:47.748488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:47.759947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 868/1769] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:47.764180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:47.779188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6635f-b788-4878-b3b2-2449d6c2d4ef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:47.784528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16081c3-7d43-4e7c-bfb7-8443b2307439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:47.785267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16081c3-7d43-4e7c-bfb7-8443b2307439 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.789394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16081c3-7d43-4e7c-bfb7-8443b2307439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.789394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16081c3-7d43-4e7c-bfb7-8443b2307439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.789394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16081c3-7d43-4e7c-bfb7-8443b2307439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:47.789394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16081c3-7d43-4e7c-bfb7-8443b2307439 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:47.805016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 902/1770] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:47.808508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:47.823014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b80-b956-4843-9282-5a96e08f181e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:47.828514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:47.829919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.830430 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.830805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] PATH_INFO: `/v3/projects/010d2f23bd8543e882b1ae3beb67a12f/users/f5f9719e0e094c008ebb42197fb26ae5/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.858005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=010d2f23bd8543e882b1ae3beb67a12f, user_id=f5f9719e0e094c008ebb42197fb26ae5, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:47.861862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:47.880199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 869/1771] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:47 2022] PUT /identity/v3/projects/010d2f23bd8543e882b1ae3beb67a12f/users/f5f9719e0e094c008ebb42197fb26ae5/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:47.891679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150a46-6017-4e32-9994-9696ff26025f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:47.892256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150a46-6017-4e32-9994-9696ff26025f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:47.892717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150a46-6017-4e32-9994-9696ff26025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:47.934752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e8150a46-6017-4e32-9994-9696ff26025f None None] MFA Rules not processed for user `f5f9719e0e094c008ebb42197fb26ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:47.936172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8150a46-6017-4e32-9994-9696ff26025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:48.021448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 903/1772] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:48.022669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:48.121241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:48.138181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1748f-50fc-46ed-a56c-410a465940ed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:48.144031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:48.144849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.145243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.145518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.151230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:48.151230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:48.200731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 870/1773] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:48 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:12:48.205386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8150a46-6017-4e32-9994-9696ff26025f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:48.218106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8150a46-6017-4e32-9994-9696ff26025f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:48.291659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:48.292357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.292687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.292994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.293631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:48.295684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:48.321357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 904/1774] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:48 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:48.325623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:48.336508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04451f64-2d5c-4593-8263-60a5a549f83a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:48.341215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:48.341817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.342097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.342371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.343009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:48.345285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:48.356268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 871/1775] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:48.360473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:48.370471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada22d5-46fa-4c7a-b2c6-ffe4a83871b5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:48.375098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:48.375797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.376077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.376355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] PATH_INFO: `/v3/projects/9260344b6234415d844748c030ff6680/users/8dce5e47f8e74ed8aeef713aa1522dd6/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.390605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9260344b6234415d844748c030ff6680, user_id=8dce5e47f8e74ed8aeef713aa1522dd6, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:48.393811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:48.406223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 905/1776] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:48 2022] PUT /identity/v3/projects/9260344b6234415d844748c030ff6680/users/8dce5e47f8e74ed8aeef713aa1522dd6/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:48.410792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:48.420537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ebf1-0a5f-4573-b967-89fe89b14588 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:48.476912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06316763-26c3-4712-990a-8a6431ec2669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:48.477805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06316763-26c3-4712-990a-8a6431ec2669 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.478132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06316763-26c3-4712-990a-8a6431ec2669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.478406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06316763-26c3-4712-990a-8a6431ec2669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.479040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06316763-26c3-4712-990a-8a6431ec2669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:48.480620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06316763-26c3-4712-990a-8a6431ec2669 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:48.490348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 872/1777] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:48.494425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:48.499973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:48.506440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6dd17-b010-4299-bd0b-582f948909e6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:48.511422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:48.512069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.512346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.512623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] PATH_INFO: `/v3/projects/9260344b6234415d844748c030ff6680/users/8dce5e47f8e74ed8aeef713aa1522dd6/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.514546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9260344b6234415d844748c030ff6680, user_id=8dce5e47f8e74ed8aeef713aa1522dd6, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:48.517772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:48.527898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 906/1778] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:48 2022] PUT /identity/v3/projects/9260344b6234415d844748c030ff6680/users/8dce5e47f8e74ed8aeef713aa1522dd6/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:48.538596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c1a3-c7e8-4862-a5f7-878f2aa0ecf5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.538884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c1a3-c7e8-4862-a5f7-878f2aa0ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.539157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c1a3-c7e8-4862-a5f7-878f2aa0ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.569759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e275c1a3-c7e8-4862-a5f7-878f2aa0ecf5 None None] MFA Rules not processed for user `8dce5e47f8e74ed8aeef713aa1522dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:48.570961 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e275c1a3-c7e8-4862-a5f7-878f2aa0ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:48.638394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 873/1779] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:48.650877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:48.652551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:48.708820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8a72-bd29-44be-9b8c-6f2bfe4c7970 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:48.712478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:48.713111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:48.713392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:48.713666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:48.768996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:48.770450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:48.779262 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 907/1780] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:50.143418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275c1a3-c7e8-4862-a5f7-878f2aa0ecf5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:50.153025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275c1a3-c7e8-4862-a5f7-878f2aa0ecf5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:50.156482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822db15-24da-4271-9d24-1b00c07da038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:50.157161 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822db15-24da-4271-9d24-1b00c07da038 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:50.157437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822db15-24da-4271-9d24-1b00c07da038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:50.157703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822db15-24da-4271-9d24-1b00c07da038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:50.166762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822db15-24da-4271-9d24-1b00c07da038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:50.168340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822db15-24da-4271-9d24-1b00c07da038 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:50.178978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 874/1781] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:53.977761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:54.038817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfddaf-2137-4fd6-99c3-89d9f7413184 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:54.043533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:54.044162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:54.044442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:54.044714 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] PATH_INFO: `/v3/users/f5f9719e0e094c008ebb42197fb26ae5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:54.045860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f9719e0e094c008ebb42197fb26ae5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:54.047857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:54.094229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:54.096021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f9719e0e094c008ebb42197fb26ae5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.106605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f9719e0e094c008ebb42197fb26ae5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.107350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f9719e0e094c008ebb42197fb26ae5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.107957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f9719e0e094c008ebb42197fb26ae5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.122467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f9719e0e094c008ebb42197fb26ae5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.135755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 908/1782] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:53 2022] DELETE /identity/v3/users/f5f9719e0e094c008ebb42197fb26ae5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:12:54.140401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75668217-b050-4045-b126-b1f833369538 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:54.140874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75668217-b050-4045-b126-b1f833369538 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:54.140965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75668217-b050-4045-b126-b1f833369538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:54.162338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-75668217-b050-4045-b126-b1f833369538 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:54.163547 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-75668217-b050-4045-b126-b1f833369538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:54.193073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:54.229024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 875/1783] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:54.239544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:54.241276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:54.301475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c516242-d099-475f-93a4-413b2498e312 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:54.305095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:54.305709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:54.306500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:54.306500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:54.316104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:54.317613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:54.327952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 909/1784] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:54.624959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75668217-b050-4045-b126-b1f833369538 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:54.626509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-75668217-b050-4045-b126-b1f833369538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:54.640037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75668217-b050-4045-b126-b1f833369538 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:54.644904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:54.645667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:54.646023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:54.646437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] PATH_INFO: `/v3/projects/010d2f23bd8543e882b1ae3beb67a12f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:54.650461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] RBAC: Authorizing `identity:delete_project(project_id=010d2f23bd8543e882b1ae3beb67a12f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:54.650461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:54.708404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010d2f23bd8543e882b1ae3beb67a12f', 'request_id': 'req-6a632336-fbe2-48ae-98be-a5274cd7068a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.714303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010d2f23bd8543e882b1ae3beb67a12f', 'request_id': 'req-6a632336-fbe2-48ae-98be-a5274cd7068a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.722777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010d2f23bd8543e882b1ae3beb67a12f', 'request_id': 'req-6a632336-fbe2-48ae-98be-a5274cd7068a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.735748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] The token cache is being invalidate because project 010d2f23bd8543e882b1ae3beb67a12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:54.736154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.736835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.738460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 876/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:54 2022] DELETE /identity/v3/projects/010d2f23bd8543e882b1ae3beb67a12f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:54.742508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:54.752909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643081f5-325f-41b4-97b9-6f5435d4db57 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:54.829455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:54.830122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:54.830397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:54.830675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] PATH_INFO: `/v3/users/8dce5e47f8e74ed8aeef713aa1522dd6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:54.831907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dce5e47f8e74ed8aeef713aa1522dd6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:54.833863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:54.879569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dce5e47f8e74ed8aeef713aa1522dd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.886399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dce5e47f8e74ed8aeef713aa1522dd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.887097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dce5e47f8e74ed8aeef713aa1522dd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.888354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dce5e47f8e74ed8aeef713aa1522dd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.896266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:54.901389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d39a7d39-623d-4b40-9d90-ebaba706a1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dce5e47f8e74ed8aeef713aa1522dd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:54.914824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 910/1786] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:54 2022] DELETE /identity/v3/users/8dce5e47f8e74ed8aeef713aa1522dd6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:55.191281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.192725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:55.205538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a632336-fbe2-48ae-98be-a5274cd7068a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.263526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.264176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.264455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.264727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] PATH_INFO: `/v3/projects/9260344b6234415d844748c030ff6680` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.265981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9260344b6234415d844748c030ff6680)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.267938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:55.315835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9260344b6234415d844748c030ff6680', 'request_id': 'req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:55.321514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9260344b6234415d844748c030ff6680', 'request_id': 'req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:55.324020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:55.329380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9260344b6234415d844748c030ff6680', 'request_id': 'req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:55.341913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] The token cache is being invalidate because project 9260344b6234415d844748c030ff6680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:12:55.342200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:55.342850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ffda64e4-d3ff-4f53-ac27-62e4cd9ea28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:55.344336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 877/1787] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:12:55 2022] DELETE /identity/v3/projects/9260344b6234415d844748c030ff6680 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:55.349685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe756fc-5cdf-43ef-bd5a-e687ea30a05d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.350158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe756fc-5cdf-43ef-bd5a-e687ea30a05d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.350261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe756fc-5cdf-43ef-bd5a-e687ea30a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.372304 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cfe756fc-5cdf-43ef-bd5a-e687ea30a05d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:55.373077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cfe756fc-5cdf-43ef-bd5a-e687ea30a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:55.435779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 911/1788] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:55.443536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630cb2c-d71e-4b0d-a46d-3055e3e99ad8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.443829 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630cb2c-d71e-4b0d-a46d-3055e3e99ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.444105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630cb2c-d71e-4b0d-a46d-3055e3e99ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.463536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b630cb2c-d71e-4b0d-a46d-3055e3e99ad8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:55.464744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b630cb2c-d71e-4b0d-a46d-3055e3e99ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:55.475592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 878/1789] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:55.480170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe756fc-5cdf-43ef-bd5a-e687ea30a05d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.490343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe756fc-5cdf-43ef-bd5a-e687ea30a05d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.495025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.495634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.495913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.496184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.496829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:12:55.497172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.498760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:55.510347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 912/1790] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:12:55.514758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630cb2c-d71e-4b0d-a46d-3055e3e99ad8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.525343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630cb2c-d71e-4b0d-a46d-3055e3e99ad8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.533112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.533112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.533112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.533112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.533489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.534165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:55.566671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 879/1791] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:55 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:55.571054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.581585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c7a1b-04fd-47bf-99b4-45ee3a3b7195 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.644876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.645526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.645812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.646088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.646729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.648684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:55.673235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 913/1792] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:55 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:55.674364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.684783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b48d3-14a9-481f-95dc-dcdeacaaa4f6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.690432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.691032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.691314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.691584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.692348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.694153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:55.705313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 880/1793] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:55.709325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.719349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81e1e-1652-4278-971e-c4f273097d0b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.723900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8baa59-2264-419f-ad52-0c111dfd4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.724492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baa59-2264-419f-ad52-0c111dfd4ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.724777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baa59-2264-419f-ad52-0c111dfd4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.725084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baa59-2264-419f-ad52-0c111dfd4ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.725729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8baa59-2264-419f-ad52-0c111dfd4ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.727311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8baa59-2264-419f-ad52-0c111dfd4ea0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:55.739397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 914/1794] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:55.743326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.754004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2231fcb-14d2-42b4-a1c7-d7ca02dc88ef admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.758909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.759562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.759837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.760125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] PATH_INFO: `/v3/projects/a02c9bbfe2fc42908d64036e6d4074c4/users/40cb149d976942989b3039139a174319/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.776157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02c9bbfe2fc42908d64036e6d4074c4, user_id=40cb149d976942989b3039139a174319, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.778885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:55.792381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 881/1795] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:55 2022] PUT /identity/v3/projects/a02c9bbfe2fc42908d64036e6d4074c4/users/40cb149d976942989b3039139a174319/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:55.804197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759088-9cfb-4298-a8b5-08dd6d0929b7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.804479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759088-9cfb-4298-a8b5-08dd6d0929b7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.804752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759088-9cfb-4298-a8b5-08dd6d0929b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.834974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e8759088-9cfb-4298-a8b5-08dd6d0929b7 None None] MFA Rules not processed for user `40cb149d976942989b3039139a174319`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:55.836310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8759088-9cfb-4298-a8b5-08dd6d0929b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:55.884112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:55.911856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 915/1796] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:55.916302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:55.989917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14755a78-0f91-476f-932a-957c3a7b49d9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:55.994762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:55.995370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:55.995649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:55.995922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:55.996551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:55.998487 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.026790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 882/1797] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:12:55 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:56.031125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759088-9cfb-4298-a8b5-08dd6d0929b7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:56.042595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759088-9cfb-4298-a8b5-08dd6d0929b7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:56.145630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:56.146255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.146532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.146945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.147583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:56.149587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.173018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 916/1798] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:12:56 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:12:56.178213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:56.189341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228292d8-ae3b-43f4-a677-4a58876f37d5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:56.194082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:56.194727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.194950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.195221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.195982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:56.197606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.209229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 883/1799] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:12:56.213605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:56.223879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560601c8-7174-44b7-9e21-48687bba9871 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:56.228985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:56.229671 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.229947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.230218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] PATH_INFO: `/v3/projects/c4091ab150e44f7ca8867c153e0df0da/users/2d9636a547334d1dbfd924731b65ba7c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.244641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4091ab150e44f7ca8867c153e0df0da, user_id=2d9636a547334d1dbfd924731b65ba7c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:56.247301 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.260870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 917/1800] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:56 2022] PUT /identity/v3/projects/c4091ab150e44f7ca8867c153e0df0da/users/2d9636a547334d1dbfd924731b65ba7c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:56.264778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:56.275459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e63b4-0a64-420d-89e7-dbfc5d708212 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:56.331118 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3eb24-a2cd-4d0a-9113-fc21f6c17a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:56.331725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3eb24-a2cd-4d0a-9113-fc21f6c17a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.332000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3eb24-a2cd-4d0a-9113-fc21f6c17a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.332267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3eb24-a2cd-4d0a-9113-fc21f6c17a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.332894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3eb24-a2cd-4d0a-9113-fc21f6c17a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:56.334492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3eb24-a2cd-4d0a-9113-fc21f6c17a24 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.335669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:56.346583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 884/1801] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:12:56.350362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:56.361072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c503-38ec-40da-8d4f-7bbcc1201639 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:56.365717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:56.366368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.366651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.366924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] PATH_INFO: `/v3/projects/c4091ab150e44f7ca8867c153e0df0da/users/2d9636a547334d1dbfd924731b65ba7c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.368822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4091ab150e44f7ca8867c153e0df0da, user_id=2d9636a547334d1dbfd924731b65ba7c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:56.371487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.382123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 918/1802] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:12:56 2022] PUT /identity/v3/projects/c4091ab150e44f7ca8867c153e0df0da/users/2d9636a547334d1dbfd924731b65ba7c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:56.392633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631d36-299c-4a31-bbd7-76563f03cca7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.392921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631d36-299c-4a31-bbd7-76563f03cca7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.393224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631d36-299c-4a31-bbd7-76563f03cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.420633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-54631d36-299c-4a31-bbd7-76563f03cca7 None None] MFA Rules not processed for user `2d9636a547334d1dbfd924731b65ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:56.421871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-54631d36-299c-4a31-bbd7-76563f03cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:56.488995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 885/1803] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:56.500263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:56.502557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:56.561217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fba0-2791-4d21-b83e-e21e09db0662 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:56.565900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:56.566513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.566797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.567070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.576661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:56.578119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.588359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 919/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:56.718398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54631d36-299c-4a31-bbd7-76563f03cca7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:56.728378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54631d36-299c-4a31-bbd7-76563f03cca7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:56.731875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa2785-8324-42e4-81d5-e3439dd9aabe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:56.732477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2785-8324-42e4-81d5-e3439dd9aabe service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:56.732758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2785-8324-42e4-81d5-e3439dd9aabe service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:56.733064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2785-8324-42e4-81d5-e3439dd9aabe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:56.790686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa2785-8324-42e4-81d5-e3439dd9aabe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:56.792179 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa2785-8324-42e4-81d5-e3439dd9aabe service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:56.802587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 886/1805] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:59.406121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:59.447068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:59.472811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f38ab-a8a7-488a-8d84-2275b8ddb1d9 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:59.477742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:59.478421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:59.478701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:59.478972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] PATH_INFO: `/v3/users/40cb149d976942989b3039139a174319` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:59.480083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cb149d976942989b3039139a174319)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:59.482064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:59.527693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cb149d976942989b3039139a174319'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:59.535929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cb149d976942989b3039139a174319'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:59.536745 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cb149d976942989b3039139a174319'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:59.537444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cb149d976942989b3039139a174319'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:59.550472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cb149d976942989b3039139a174319'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:12:59.563585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 920/1806] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:12:59 2022] DELETE /identity/v3/users/40cb149d976942989b3039139a174319 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:12:59.568751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250986-6e84-4534-a46a-73b26070b99b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:59.569255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250986-6e84-4534-a46a-73b26070b99b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:59.569360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250986-6e84-4534-a46a-73b26070b99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:59.589408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-91250986-6e84-4534-a46a-73b26070b99b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:59.590636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-91250986-6e84-4534-a46a-73b26070b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:59.651860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 887/1807] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:59.662158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:59.663636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:59.720698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f1ae4-2f55-451f-94ec-78ce2e8548c9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:59.724442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:59.725083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:59.725364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:59.725632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:59.734970 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:59.736391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:59.746996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 921/1808] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:00.055637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91250986-6e84-4534-a46a-73b26070b99b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:00.057880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-91250986-6e84-4534-a46a-73b26070b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:00.072131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91250986-6e84-4534-a46a-73b26070b99b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:00.077346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:00.077999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:00.078325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:00.078549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] PATH_INFO: `/v3/projects/a02c9bbfe2fc42908d64036e6d4074c4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:00.080537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02c9bbfe2fc42908d64036e6d4074c4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:00.084931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:00.103559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:00.143675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02c9bbfe2fc42908d64036e6d4074c4', 'request_id': 'req-de9339b9-a99e-4ffa-accd-55b06369cd1b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.149697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02c9bbfe2fc42908d64036e6d4074c4', 'request_id': 'req-de9339b9-a99e-4ffa-accd-55b06369cd1b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.158158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02c9bbfe2fc42908d64036e6d4074c4', 'request_id': 'req-de9339b9-a99e-4ffa-accd-55b06369cd1b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.174448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] The token cache is being invalidate because project a02c9bbfe2fc42908d64036e6d4074c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:00.174738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.175419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.177312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 888/1809] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:00 2022] DELETE /identity/v3/projects/a02c9bbfe2fc42908d64036e6d4074c4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:00.181215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:00.191965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250bc32-b26e-446c-b6a9-0a42b7e744ee service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:00.260898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:00.268389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:00.271369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:00.271369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:00.271369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] PATH_INFO: `/v3/users/2d9636a547334d1dbfd924731b65ba7c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:00.272687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9636a547334d1dbfd924731b65ba7c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:00.274222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:00.330789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9636a547334d1dbfd924731b65ba7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.338145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9636a547334d1dbfd924731b65ba7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.338823 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9636a547334d1dbfd924731b65ba7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.339422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9636a547334d1dbfd924731b65ba7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.355262 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4713e786-1c4e-4906-b32e-43019dd404fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9636a547334d1dbfd924731b65ba7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.370790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 922/1810] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:00 2022] DELETE /identity/v3/users/2d9636a547334d1dbfd924731b65ba7c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:00.645390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:00.646959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:00.660416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9339b9-a99e-4ffa-accd-55b06369cd1b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:00.724034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:00.724672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:00.724953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:00.725259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] PATH_INFO: `/v3/projects/c4091ab150e44f7ca8867c153e0df0da` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:00.726368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4091ab150e44f7ca8867c153e0df0da)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:00.728542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:00.775616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4091ab150e44f7ca8867c153e0df0da', 'request_id': 'req-525081fe-68b3-4155-b2be-cc4f6052e6d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.781589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4091ab150e44f7ca8867c153e0df0da', 'request_id': 'req-525081fe-68b3-4155-b2be-cc4f6052e6d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.788560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4091ab150e44f7ca8867c153e0df0da', 'request_id': 'req-525081fe-68b3-4155-b2be-cc4f6052e6d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.799835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] The token cache is being invalidate because project c4091ab150e44f7ca8867c153e0df0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:00.800124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.800776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-525081fe-68b3-4155-b2be-cc4f6052e6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:00.802302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 889/1811] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:00 2022] DELETE /identity/v3/projects/c4091ab150e44f7ca8867c153e0df0da => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:00.807209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37633-29bf-44c8-89b9-a9ccac2ef4ae None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:00.807681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37633-29bf-44c8-89b9-a9ccac2ef4ae None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:00.807793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37633-29bf-44c8-89b9-a9ccac2ef4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:00.830849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b2e37633-29bf-44c8-89b9-a9ccac2ef4ae None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:00.832097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2e37633-29bf-44c8-89b9-a9ccac2ef4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:00.893995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 923/1812] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:00.909655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459220e2-25ac-4a43-ad35-a27556afce72 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:00.909969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459220e2-25ac-4a43-ad35-a27556afce72 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:00.910374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459220e2-25ac-4a43-ad35-a27556afce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:00.930533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-459220e2-25ac-4a43-ad35-a27556afce72 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:00.931655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-459220e2-25ac-4a43-ad35-a27556afce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:00.940648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 890/1813] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:00.944932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e37633-29bf-44c8-89b9-a9ccac2ef4ae None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:00.955282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e37633-29bf-44c8-89b9-a9ccac2ef4ae None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:00.959950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:00.960559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:00.960848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:00.961260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:00.961944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:00.962246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:00.963880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:00.977723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 924/1814] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:00.981981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459220e2-25ac-4a43-ad35-a27556afce72 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:00.991752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459220e2-25ac-4a43-ad35-a27556afce72 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:00.996385 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:00.996997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:00.997278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:00.997546 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:00.998167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.000081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.028738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 891/1815] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:00 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:13:01.033028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.043783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4106c-7887-4276-b58e-8224e2d4c79a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.100523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.101184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.101466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.101738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.102633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.104549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.115131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:01.129694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 925/1816] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:01 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:01.133682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.140286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:01.144307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad3ee6-dbce-4eb2-8ad3-5354c362f7b6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.150649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.151267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.151736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.152178 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.152819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.154462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.165957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 892/1817] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:01.168391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.179523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec15ac2-be0a-4608-957d-7c62f598f6e8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.184257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580ba0-1922-484c-b30b-07689bf82db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.184801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580ba0-1922-484c-b30b-07689bf82db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.185121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580ba0-1922-484c-b30b-07689bf82db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.185399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580ba0-1922-484c-b30b-07689bf82db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.186039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580ba0-1922-484c-b30b-07689bf82db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.187645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580ba0-1922-484c-b30b-07689bf82db3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.199529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 926/1818] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:01.203478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.214714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4539-1210-451d-88b4-c2961d5e9e52 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.219968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.220626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.220910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.221215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] PATH_INFO: `/v3/projects/83b8594b8d244eeb8dc71697fafb6ee3/users/83c201782ca54704922a04de27760e0e/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.236288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b8594b8d244eeb8dc71697fafb6ee3, user_id=83c201782ca54704922a04de27760e0e, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.239329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.254115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 893/1819] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:01 2022] PUT /identity/v3/projects/83b8594b8d244eeb8dc71697fafb6ee3/users/83c201782ca54704922a04de27760e0e/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:01.265084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168025-7d65-43c8-a872-d7c8ddde9c04 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.265377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168025-7d65-43c8-a872-d7c8ddde9c04 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.265688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168025-7d65-43c8-a872-d7c8ddde9c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.295644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d2168025-7d65-43c8-a872-d7c8ddde9c04 None None] MFA Rules not processed for user `83c201782ca54704922a04de27760e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:01.296881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d2168025-7d65-43c8-a872-d7c8ddde9c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:01.380056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 927/1820] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:01.381924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.461263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff481c5-c751-4fb2-931d-2a9aff84bcca admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.466250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.466864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.467143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.467413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.468196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.470606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.523233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 894/1821] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:01 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:13:01.524509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168025-7d65-43c8-a872-d7c8ddde9c04 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.541810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168025-7d65-43c8-a872-d7c8ddde9c04 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.606967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.607715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.608003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.608280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.608920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.611153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.641524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 928/1822] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:01 2022] POST /identity/v3/users => generated 301 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:01.642722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.656045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdac0c-d932-45b2-b4f7-b0c1d5a7ea2b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.661839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.662515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.662845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.663208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.663983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.665766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.679594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 895/1823] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:01.683464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.698157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee017-bec2-474e-bc20-b17852d3fa1a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.709512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.709920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.710203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.710571 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] PATH_INFO: `/v3/projects/501a2a069e8d4171b2791ce38b2c9cc4/users/2b8e71af263d4d1ab799c69c4eb1d406/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.730347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501a2a069e8d4171b2791ce38b2c9cc4, user_id=2b8e71af263d4d1ab799c69c4eb1d406, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.735101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.752838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 929/1824] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:01 2022] PUT /identity/v3/projects/501a2a069e8d4171b2791ce38b2c9cc4/users/2b8e71af263d4d1ab799c69c4eb1d406/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:13:01.753914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.764168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d009a2-ce36-4032-8954-779cfcb679cb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.822001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46865f96-1a24-4bd0-b5a7-8e2d96c17f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.822608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865f96-1a24-4bd0-b5a7-8e2d96c17f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.822886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865f96-1a24-4bd0-b5a7-8e2d96c17f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.823149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865f96-1a24-4bd0-b5a7-8e2d96c17f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.823774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46865f96-1a24-4bd0-b5a7-8e2d96c17f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.825376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46865f96-1a24-4bd0-b5a7-8e2d96c17f62 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.835628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 896/1825] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:01.839919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.850103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d468c3-7c29-4801-84eb-caa5052f8653 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:01.854931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:01.855569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.855845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.856115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] PATH_INFO: `/v3/projects/501a2a069e8d4171b2791ce38b2c9cc4/users/2b8e71af263d4d1ab799c69c4eb1d406/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.858025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501a2a069e8d4171b2791ce38b2c9cc4, user_id=2b8e71af263d4d1ab799c69c4eb1d406, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:01.861200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:01.871243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 930/1826] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:01 2022] PUT /identity/v3/projects/501a2a069e8d4171b2791ce38b2c9cc4/users/2b8e71af263d4d1ab799c69c4eb1d406/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:01.881793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7265-30e3-4670-b3e1-177b7464db84 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:01.882082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7265-30e3-4670-b3e1-177b7464db84 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:01.882360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7265-30e3-4670-b3e1-177b7464db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:01.909879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b96f7265-30e3-4670-b3e1-177b7464db84 None None] MFA Rules not processed for user `2b8e71af263d4d1ab799c69c4eb1d406`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:01.911148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b96f7265-30e3-4670-b3e1-177b7464db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:01.941190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:01.982260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 897/1827] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:01.992869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:01.994584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:02.022039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:02.052056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efc17e-9aba-4628-b63d-48f4d28e1aa2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:02.055605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2469-8d79-42d2-9f44-00ecc04e020d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:02.056199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2469-8d79-42d2-9f44-00ecc04e020d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:02.056472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2469-8d79-42d2-9f44-00ecc04e020d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:02.056739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2469-8d79-42d2-9f44-00ecc04e020d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:02.065888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2469-8d79-42d2-9f44-00ecc04e020d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:02.067298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2469-8d79-42d2-9f44-00ecc04e020d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:02.076367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 931/1828] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:02.209884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7265-30e3-4670-b3e1-177b7464db84 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:02.273588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7265-30e3-4670-b3e1-177b7464db84 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:02.279167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:02.279857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:02.280135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:02.280414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] PATH_INFO: `/v3/users/83c201782ca54704922a04de27760e0e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:02.281558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c201782ca54704922a04de27760e0e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:02.284116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:02.331080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c201782ca54704922a04de27760e0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.331734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c201782ca54704922a04de27760e0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.340373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c201782ca54704922a04de27760e0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.341246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c201782ca54704922a04de27760e0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.357141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c201782ca54704922a04de27760e0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.371370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 898/1829] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:02 2022] DELETE /identity/v3/users/83c201782ca54704922a04de27760e0e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:02.375876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006863-e32d-45df-bef8-db142183a565 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:02.376157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006863-e32d-45df-bef8-db142183a565 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:02.376426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006863-e32d-45df-bef8-db142183a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:02.395022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ef006863-e32d-45df-bef8-db142183a565 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:02.396243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef006863-e32d-45df-bef8-db142183a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:02.453180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 932/1830] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:02.463283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:02.464680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:02.513165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:02.527976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c834a-a716-4c33-a4da-e8e44c5384f1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:02.533149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:02.533768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:02.534046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:02.534336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:02.544481 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:02.546054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:02.556034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 899/1831] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:02.852256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef006863-e32d-45df-bef8-db142183a565 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:02.853962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef006863-e32d-45df-bef8-db142183a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:02.875932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef006863-e32d-45df-bef8-db142183a565 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:02.889181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:02.889865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:02.890146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:02.890415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] PATH_INFO: `/v3/projects/83b8594b8d244eeb8dc71697fafb6ee3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:02.892553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b8594b8d244eeb8dc71697fafb6ee3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:02.903478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:02.965915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b8594b8d244eeb8dc71697fafb6ee3', 'request_id': 'req-6afcd247-08cc-4f78-bc2b-d9f8d8105234'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.975133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b8594b8d244eeb8dc71697fafb6ee3', 'request_id': 'req-6afcd247-08cc-4f78-bc2b-d9f8d8105234'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.982263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b8594b8d244eeb8dc71697fafb6ee3', 'request_id': 'req-6afcd247-08cc-4f78-bc2b-d9f8d8105234'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.997401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] The token cache is being invalidate because project 83b8594b8d244eeb8dc71697fafb6ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:02.997779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:02.998792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.005249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 933/1832] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:02 2022] DELETE /identity/v3/projects/83b8594b8d244eeb8dc71697fafb6ee3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:03.005965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:03.018597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6e72d-8fd9-4fe8-af8b-e272aa7b967f service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:03.084352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:03.085003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:03.085412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:03.085581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] PATH_INFO: `/v3/users/2b8e71af263d4d1ab799c69c4eb1d406` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:03.086701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8e71af263d4d1ab799c69c4eb1d406)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:03.088597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:03.150396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8e71af263d4d1ab799c69c4eb1d406'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.152010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8e71af263d4d1ab799c69c4eb1d406'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.161838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8e71af263d4d1ab799c69c4eb1d406'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.163370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8e71af263d4d1ab799c69c4eb1d406'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.179790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53a034c7-ed3c-4abe-a108-91eee86acefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8e71af263d4d1ab799c69c4eb1d406'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.200922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 900/1833] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:03 2022] DELETE /identity/v3/users/2b8e71af263d4d1ab799c69c4eb1d406 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:13:03.573244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:03.574701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:03.588847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcd247-08cc-4f78-bc2b-d9f8d8105234 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:03.649577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:03.663125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:03.663956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:03.664267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:03.664534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] PATH_INFO: `/v3/projects/501a2a069e8d4171b2791ce38b2c9cc4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:03.665719 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501a2a069e8d4171b2791ce38b2c9cc4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:03.667673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:03.734553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501a2a069e8d4171b2791ce38b2c9cc4', 'request_id': 'req-ee4a4945-9151-46e4-8d98-06cabc7cc331'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.743588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501a2a069e8d4171b2791ce38b2c9cc4', 'request_id': 'req-ee4a4945-9151-46e4-8d98-06cabc7cc331'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.751956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501a2a069e8d4171b2791ce38b2c9cc4', 'request_id': 'req-ee4a4945-9151-46e4-8d98-06cabc7cc331'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.767701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] The token cache is being invalidate because project 501a2a069e8d4171b2791ce38b2c9cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:03.768305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.769054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ee4a4945-9151-46e4-8d98-06cabc7cc331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:03.770709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 934/1834] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:03 2022] DELETE /identity/v3/projects/501a2a069e8d4171b2791ce38b2c9cc4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:03.775756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727129f6-d497-444f-af24-768771357d0f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:03.776042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727129f6-d497-444f-af24-768771357d0f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:03.776364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727129f6-d497-444f-af24-768771357d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:03.799163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-727129f6-d497-444f-af24-768771357d0f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:03.800416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-727129f6-d497-444f-af24-768771357d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:03.884889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 901/1835] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:03.894486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d6c7-7ef8-4b93-8580-f57d2c9df1e2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:03.894923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d6c7-7ef8-4b93-8580-f57d2c9df1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:03.895084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d6c7-7ef8-4b93-8580-f57d2c9df1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:03.915191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a269d6c7-7ef8-4b93-8580-f57d2c9df1e2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:03.916391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a269d6c7-7ef8-4b93-8580-f57d2c9df1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:03.927585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 935/1836] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:03.928805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727129f6-d497-444f-af24-768771357d0f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:03.938943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727129f6-d497-444f-af24-768771357d0f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:03.943458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:03.944055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:03.944327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:03.944591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:03.945262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:03.945561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:03.947129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:03.948596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:03.960675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 902/1837] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:03.965196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269d6c7-7ef8-4b93-8580-f57d2c9df1e2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:03.974330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269d6c7-7ef8-4b93-8580-f57d2c9df1e2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:03.979155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:03.979756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:03.980032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:03.980303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:03.980934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:03.982847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.010624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 936/1838] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:03 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:04.014722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.024754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38703aa-68af-4976-af1f-c98bef6dab94 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.087543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e84f-abd4-4b2f-bf5c-ce27ed5b7632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.089645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e84f-abd4-4b2f-bf5c-ce27ed5b7632 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.089981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e84f-abd4-4b2f-bf5c-ce27ed5b7632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.090259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e84f-abd4-4b2f-bf5c-ce27ed5b7632 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.090899 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e84f-abd4-4b2f-bf5c-ce27ed5b7632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.092786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e84f-abd4-4b2f-bf5c-ce27ed5b7632 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.116908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 903/1839] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:04 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:04.121298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.132861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6df930-9920-4157-aa30-d8f6f53d6661 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.137708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8148b7-5b2a-448f-b5c5-b025126c3594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.138378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8148b7-5b2a-448f-b5c5-b025126c3594 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.138658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8148b7-5b2a-448f-b5c5-b025126c3594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.138928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8148b7-5b2a-448f-b5c5-b025126c3594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.139596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8148b7-5b2a-448f-b5c5-b025126c3594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.141246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8148b7-5b2a-448f-b5c5-b025126c3594 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.146831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424790d0-c3dd-464d-82d4-01358b2fddce None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.146831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424790d0-c3dd-464d-82d4-01358b2fddce None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.147152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424790d0-c3dd-464d-82d4-01358b2fddce None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.148745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 904/1840] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:13:04.152998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 937/1841] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:04.155312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424790d0-c3dd-464d-82d4-01358b2fddce None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.162833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e616-181f-4a60-adc5-23436f4075b0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.163244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e616-181f-4a60-adc5-23436f4075b0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.163524 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e616-181f-4a60-adc5-23436f4075b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.168327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424790d0-c3dd-464d-82d4-01358b2fddce None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.173870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.174790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.175072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.175340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.176032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.177801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.185898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1166e616-181f-4a60-adc5-23436f4075b0 None None] MFA Rules not processed for user `c398dc49ac8241aab3112a5ac879b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:04.187016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1166e616-181f-4a60-adc5-23436f4075b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.192744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 905/1842] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:04.193945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.204722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baded956-c6a4-44bc-a481-393703fa0cac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.213905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.214580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.214862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.215190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] PATH_INFO: `/v3/projects/81179bda26e04acc9c6eb0560e893587/users/024c459f1e804020a677ce8686f40a52/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.236882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81179bda26e04acc9c6eb0560e893587, user_id=024c459f1e804020a677ce8686f40a52, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.240004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.256723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 906/1843] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:04 2022] PUT /identity/v3/projects/81179bda26e04acc9c6eb0560e893587/users/024c459f1e804020a677ce8686f40a52/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:04.263721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.263721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.269857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 938/1844] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:13:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:04.274568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.274854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.275151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.308109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] MFA Rules not processed for user `024c459f1e804020a677ce8686f40a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:04.309337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.330081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538c2e5-3b88-4f66-beb5-6f6d48822f4c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.334827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.335566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.335987 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.336262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] PATH_INFO: `/v3/users/3f4f1b6d841b4c81ae0a94ed7804b0f9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.337568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4f1b6d841b4c81ae0a94ed7804b0f9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.339472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.340410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:04.391559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 939/1845] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:04.392567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.397559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.403194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4f1b6d841b4c81ae0a94ed7804b0f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.403878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4f1b6d841b4c81ae0a94ed7804b0f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.408138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:04.415775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4f1b6d841b4c81ae0a94ed7804b0f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.416953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4f1b6d841b4c81ae0a94ed7804b0f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.433182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4f1b6d841b4c81ae0a94ed7804b0f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.445668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 907/1846] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:04 2022] DELETE /identity/v3/users/3f4f1b6d841b4c81ae0a94ed7804b0f9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:04.446642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.447969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.478585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15dcf-b9d4-4f37-b1cb-72852203c3fa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.526102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f92845-e5c3-4fd4-9f83-744ccfdbb655 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.533504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.534132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.534405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.534672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.536472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.557601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.558297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.558645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.558984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.561276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.573483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.575264 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.586431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 940/1847] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:04.610843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.612375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.622620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 908/1848] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:04.638691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.640194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.717996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11327a-d58b-4d17-bb79-7009921c2a7c service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.722613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.723245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.723522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.723787 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] PATH_INFO: `/v3/projects/f7f102e064b14d5ea0dc89109f608db6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.724895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f102e064b14d5ea0dc89109f608db6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.726806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.728542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:04.779644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f102e064b14d5ea0dc89109f608db6', 'request_id': 'req-e89e1bc5-510e-4cb1-9114-435e7f0cc285'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.789229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f102e064b14d5ea0dc89109f608db6', 'request_id': 'req-e89e1bc5-510e-4cb1-9114-435e7f0cc285'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.796288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f102e064b14d5ea0dc89109f608db6', 'request_id': 'req-e89e1bc5-510e-4cb1-9114-435e7f0cc285'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.811878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] The token cache is being invalidate because project f7f102e064b14d5ea0dc89109f608db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:04.812173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.813948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:04.817652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 941/1849] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:04 2022] DELETE /identity/v3/projects/f7f102e064b14d5ea0dc89109f608db6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:04.822270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:04.834138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5402b-0439-4ca8-a2ea-add4e763c885 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:04.933735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:04.934545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.934831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.935106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] PATH_INFO: `/v3/users/61530be8e6c9490984f487ea5dbd1378` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.936344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61530be8e6c9490984f487ea5dbd1378)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:04.938890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:04.976224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:05.010009 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61530be8e6c9490984f487ea5dbd1378'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.011470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61530be8e6c9490984f487ea5dbd1378'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.020484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61530be8e6c9490984f487ea5dbd1378'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.022300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61530be8e6c9490984f487ea5dbd1378'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.040263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-38d012d8-0ddf-408a-84e4-a2f119227183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61530be8e6c9490984f487ea5dbd1378'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.053388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 909/1850] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:04 2022] DELETE /identity/v3/users/61530be8e6c9490984f487ea5dbd1378 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:05.247050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.248598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:05.263407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1bc5-510e-4cb1-9114-435e7f0cc285 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.320357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.320922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.321237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.321516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] PATH_INFO: `/v3/projects/82a64fd602c94c45b3c455d4da4ce6f4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.322819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a64fd602c94c45b3c455d4da4ce6f4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.324729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.371353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a64fd602c94c45b3c455d4da4ce6f4', 'request_id': 'req-8853ffb2-d054-4ee9-be87-9aa73aec37d2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.379318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a64fd602c94c45b3c455d4da4ce6f4', 'request_id': 'req-8853ffb2-d054-4ee9-be87-9aa73aec37d2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.385228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a64fd602c94c45b3c455d4da4ce6f4', 'request_id': 'req-8853ffb2-d054-4ee9-be87-9aa73aec37d2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.398145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] The token cache is being invalidate because project 82a64fd602c94c45b3c455d4da4ce6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:05.398431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.399069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8853ffb2-d054-4ee9-be87-9aa73aec37d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:05.404062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 942/1851] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:05 2022] DELETE /identity/v3/projects/82a64fd602c94c45b3c455d4da4ce6f4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:05.405850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1400d3-cbc6-4238-903a-1da2ed9dbb18 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.406190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1400d3-cbc6-4238-903a-1da2ed9dbb18 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.412123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1400d3-cbc6-4238-903a-1da2ed9dbb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.426057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c1400d3-cbc6-4238-903a-1da2ed9dbb18 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:05.427244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c1400d3-cbc6-4238-903a-1da2ed9dbb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:05.488593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 910/1852] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:05.496014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302dfd1-fb07-47a8-aca1-c36fd5134d8c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.496300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302dfd1-fb07-47a8-aca1-c36fd5134d8c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.496588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302dfd1-fb07-47a8-aca1-c36fd5134d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.517975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1302dfd1-fb07-47a8-aca1-c36fd5134d8c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:05.519190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1302dfd1-fb07-47a8-aca1-c36fd5134d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:05.526999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 943/1853] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:05.531715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1400d3-cbc6-4238-903a-1da2ed9dbb18 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.541628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1400d3-cbc6-4238-903a-1da2ed9dbb18 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.546350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.546958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.547750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.548030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.548731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:05.549277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.550823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.566041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 911/1854] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:05.571151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302dfd1-fb07-47a8-aca1-c36fd5134d8c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.580208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302dfd1-fb07-47a8-aca1-c36fd5134d8c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.585141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.585947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.586235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.586508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.587251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.589212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.600488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:05.622353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 944/1855] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:05 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:05.624312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.635039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11ed0d-9665-404b-972a-a7af577ec203 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.694890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.695510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.695904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.696080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.696725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.698847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.723699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 912/1856] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:05 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:05.724908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.736503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a20409-a1a0-492c-be53-58008553b21b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.742173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.742939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.743257 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.743510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.744155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.746102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.761303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 945/1857] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:05.762470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.775212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fbf9b-f6d6-404a-a865-9a7a1eb485b4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.780627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16defbd-8357-4b6c-b8c1-2a61c438ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.781274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16defbd-8357-4b6c-b8c1-2a61c438ff6c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.781548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16defbd-8357-4b6c-b8c1-2a61c438ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.781906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16defbd-8357-4b6c-b8c1-2a61c438ff6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.782617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16defbd-8357-4b6c-b8c1-2a61c438ff6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.784507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16defbd-8357-4b6c-b8c1-2a61c438ff6c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.799451 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 913/1858] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:13:05.803580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.814976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5d6c8-642d-40f8-85f5-c95605198fec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.820902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.821730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.822017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.822298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] PATH_INFO: `/v3/projects/3bf7b66c0903443682b76e3390b79039/users/4df24cfce957487e8062e4cbed63ca88/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.839207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf7b66c0903443682b76e3390b79039, user_id=4df24cfce957487e8062e4cbed63ca88, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.843570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.859388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 946/1859] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:05 2022] PUT /identity/v3/projects/3bf7b66c0903443682b76e3390b79039/users/4df24cfce957487e8062e4cbed63ca88/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:05.871218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650f893-01b7-482e-930c-480cbd9ace88 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.871553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650f893-01b7-482e-930c-480cbd9ace88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.871832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650f893-01b7-482e-930c-480cbd9ace88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.887968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:05.907406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9650f893-01b7-482e-930c-480cbd9ace88 None None] MFA Rules not processed for user `4df24cfce957487e8062e4cbed63ca88`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:05.908747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9650f893-01b7-482e-930c-480cbd9ace88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:05.988675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 914/1860] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:06.024941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:06.027660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:06.092440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f577b-b903-4648-9bff-377055125c23 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:06.097931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81ed62-1c79-4f6b-8964-f8c1230aae18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:06.098589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ed62-1c79-4f6b-8964-f8c1230aae18 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:06.098902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ed62-1c79-4f6b-8964-f8c1230aae18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:06.099199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ed62-1c79-4f6b-8964-f8c1230aae18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:06.108835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81ed62-1c79-4f6b-8964-f8c1230aae18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:06.110927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81ed62-1c79-4f6b-8964-f8c1230aae18 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:06.123413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 947/1861] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:06.139865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650f893-01b7-482e-930c-480cbd9ace88 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:06.268350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650f893-01b7-482e-930c-480cbd9ace88 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:06.274639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:06.275429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:06.275797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:06.276348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] PATH_INFO: `/v3/users/4df24cfce957487e8062e4cbed63ca88` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:06.277710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df24cfce957487e8062e4cbed63ca88)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:06.280010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:06.349599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df24cfce957487e8062e4cbed63ca88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:06.350321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df24cfce957487e8062e4cbed63ca88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:06.359044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df24cfce957487e8062e4cbed63ca88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:06.359763 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df24cfce957487e8062e4cbed63ca88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:06.374769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df24cfce957487e8062e4cbed63ca88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:06.396122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 915/1862] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:06 2022] DELETE /identity/v3/users/4df24cfce957487e8062e4cbed63ca88 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:06.400464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:06.400963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:06.401081 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:06.422611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:06.424559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:06.496063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 948/1863] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:06.503348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:06.505217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:06.526330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:06.575126 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a11636-2ad0-47f2-9868-a7762c0b4ade admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:06.580022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e933c5-f7c5-4046-86a6-3aa3838cfd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:06.581710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e933c5-f7c5-4046-86a6-3aa3838cfd8b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:06.582072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e933c5-f7c5-4046-86a6-3aa3838cfd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:06.582354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e933c5-f7c5-4046-86a6-3aa3838cfd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:06.593915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e933c5-f7c5-4046-86a6-3aa3838cfd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:06.595397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e933c5-f7c5-4046-86a6-3aa3838cfd8b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:06.608046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 916/1864] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:13:06.922583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:06.923631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:06.936242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490d551-905f-4ed2-95c5-d4e311a070bb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:06.942963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:06.943929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:06.944354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:06.944957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] PATH_INFO: `/v3/projects/3bf7b66c0903443682b76e3390b79039` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:06.947000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf7b66c0903443682b76e3390b79039)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:06.949082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.006107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf7b66c0903443682b76e3390b79039', 'request_id': 'req-ae94f042-26aa-4276-8d65-a34af31dbf21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.006638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d572c-802c-48e7-8aa3-8da1c9d89065 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.006929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d572c-802c-48e7-8aa3-8da1c9d89065 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.007203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d572c-802c-48e7-8aa3-8da1c9d89065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.010259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:07.014600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf7b66c0903443682b76e3390b79039', 'request_id': 'req-ae94f042-26aa-4276-8d65-a34af31dbf21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.021366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf7b66c0903443682b76e3390b79039', 'request_id': 'req-ae94f042-26aa-4276-8d65-a34af31dbf21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.028156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c35d572c-802c-48e7-8aa3-8da1c9d89065 None None] MFA Rules not processed for user `ab8ab12109f34f0ab1d13b1cf2d375d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:07.029467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c35d572c-802c-48e7-8aa3-8da1c9d89065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:07.033335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] The token cache is being invalidate because project 3bf7b66c0903443682b76e3390b79039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:07.033629 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.034265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae94f042-26aa-4276-8d65-a34af31dbf21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.035743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 949/1865] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:06 2022] DELETE /identity/v3/projects/3bf7b66c0903443682b76e3390b79039 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:07.040258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aaf78-1dcc-4464-97bb-0ef53387dae5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.040543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aaf78-1dcc-4464-97bb-0ef53387dae5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.040812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aaf78-1dcc-4464-97bb-0ef53387dae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.060768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f69aaf78-1dcc-4464-97bb-0ef53387dae5 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:07.062221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f69aaf78-1dcc-4464-97bb-0ef53387dae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:07.085526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 917/1866] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:07.126830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 950/1867] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:07.134665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e82bb-e303-4555-9b36-efacbd347e62 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.135060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e82bb-e303-4555-9b36-efacbd347e62 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.135452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e82bb-e303-4555-9b36-efacbd347e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.161442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6b7e82bb-e303-4555-9b36-efacbd347e62 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:07.162743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6b7e82bb-e303-4555-9b36-efacbd347e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:07.170793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 918/1868] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:07.175044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aaf78-1dcc-4464-97bb-0ef53387dae5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.184339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aaf78-1dcc-4464-97bb-0ef53387dae5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.188955 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.189578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.189852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.190120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.190763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:07.191063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.192647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.205055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 951/1869] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:07.209307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e82bb-e303-4555-9b36-efacbd347e62 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.218811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e82bb-e303-4555-9b36-efacbd347e62 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.224000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.224604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.224878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.225347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.225975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.228520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.256276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 919/1870] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:07 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:07.260417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.275163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3f7a8-35ce-41df-bdb5-018ee22b78d1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.344130 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.345458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.346095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.346473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.347249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.349343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.376558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 952/1871] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:07 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:07.381972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.408675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b80090-a7f4-4985-9bb6-e7f479c5ae85 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.417516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.418160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.418439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.418706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.419350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.420959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.435079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 920/1872] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:07.441345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.454199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8460-7e2e-4540-8617-6b186f421145 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.459712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53aeab-b644-4662-bd25-da24198ff9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.460253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53aeab-b644-4662-bd25-da24198ff9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.460516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53aeab-b644-4662-bd25-da24198ff9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.460826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53aeab-b644-4662-bd25-da24198ff9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.461464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53aeab-b644-4662-bd25-da24198ff9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.463192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53aeab-b644-4662-bd25-da24198ff9c0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.481915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 953/1873] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:13:07.487926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.515445 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38d39-71ad-4084-8c3d-7fd893a7e069 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.525951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.526991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.526991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.527181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] PATH_INFO: `/v3/projects/0eb13205cba741fd80026521f1d37fef/users/4344112c5ccc4dcea280f44a6f11b864/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.544744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb13205cba741fd80026521f1d37fef, user_id=4344112c5ccc4dcea280f44a6f11b864, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.547419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.565797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 921/1874] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:07 2022] PUT /identity/v3/projects/0eb13205cba741fd80026521f1d37fef/users/4344112c5ccc4dcea280f44a6f11b864/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:07.576199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525157-8e72-409d-a300-7b99cef489e9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.576702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525157-8e72-409d-a300-7b99cef489e9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.577156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525157-8e72-409d-a300-7b99cef489e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.609021 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-77525157-8e72-409d-a300-7b99cef489e9 None None] MFA Rules not processed for user `4344112c5ccc4dcea280f44a6f11b864`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:07.610607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-77525157-8e72-409d-a300-7b99cef489e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:07.655639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:07.687256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 954/1875] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:07.699500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.701481 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:07.761254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b543325-9a15-40f0-9d1c-f392b99febf1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.765231 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa359e-e0ec-4a67-9aeb-48d69a94e42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.765847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa359e-e0ec-4a67-9aeb-48d69a94e42a service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.766976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa359e-e0ec-4a67-9aeb-48d69a94e42a service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.767386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa359e-e0ec-4a67-9aeb-48d69a94e42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.790089 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa359e-e0ec-4a67-9aeb-48d69a94e42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.791540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa359e-e0ec-4a67-9aeb-48d69a94e42a service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.802906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 922/1876] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:07.836101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525157-8e72-409d-a300-7b99cef489e9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:07.907253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525157-8e72-409d-a300-7b99cef489e9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:07.912233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:07.912872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:07.913184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:07.913460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] PATH_INFO: `/v3/users/4344112c5ccc4dcea280f44a6f11b864` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:07.914632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4344112c5ccc4dcea280f44a6f11b864)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:07.916688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:07.974648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4344112c5ccc4dcea280f44a6f11b864'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.983828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4344112c5ccc4dcea280f44a6f11b864'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.984599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4344112c5ccc4dcea280f44a6f11b864'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:07.985318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4344112c5ccc4dcea280f44a6f11b864'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:08.008109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4344112c5ccc4dcea280f44a6f11b864'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:08.023607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 955/1877] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:07 2022] DELETE /identity/v3/users/4344112c5ccc4dcea280f44a6f11b864 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:08.028439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.028955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.029365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.038698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:08.056135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:08.057416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:08.134150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 923/1878] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:08.144631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:08.146070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:08.212855 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65add73b-d1d8-4117-930b-f6f8229beb56 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:08.219869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44564f9-2e4a-4c39-ab71-ff30e6cb5fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:08.221004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44564f9-2e4a-4c39-ab71-ff30e6cb5fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.221336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44564f9-2e4a-4c39-ab71-ff30e6cb5fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.221706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44564f9-2e4a-4c39-ab71-ff30e6cb5fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.234323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44564f9-2e4a-4c39-ab71-ff30e6cb5fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:08.237247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44564f9-2e4a-4c39-ab71-ff30e6cb5fc0 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:08.246901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:08.255308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 956/1879] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:08.537955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:08.539512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:08.553485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887b586-223a-4103-b18e-35b15f1c90b5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:08.559269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:08.560285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.560623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.560988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] PATH_INFO: `/v3/projects/0eb13205cba741fd80026521f1d37fef` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.572504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb13205cba741fd80026521f1d37fef)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:08.574662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:08.629959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb13205cba741fd80026521f1d37fef', 'request_id': 'req-7368604e-1302-41d1-b38c-3373fc77813b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:08.635903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb13205cba741fd80026521f1d37fef', 'request_id': 'req-7368604e-1302-41d1-b38c-3373fc77813b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:08.645775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb13205cba741fd80026521f1d37fef', 'request_id': 'req-7368604e-1302-41d1-b38c-3373fc77813b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:08.661113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] The token cache is being invalidate because project 0eb13205cba741fd80026521f1d37fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:08.661654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:08.662527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7368604e-1302-41d1-b38c-3373fc77813b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:08.664279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 924/1880] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:08 2022] DELETE /identity/v3/projects/0eb13205cba741fd80026521f1d37fef => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:08.670801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9291d7-2ab4-4033-9684-60410ae83a86 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.671232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9291d7-2ab4-4033-9684-60410ae83a86 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.671379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9291d7-2ab4-4033-9684-60410ae83a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.704097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ad9291d7-2ab4-4033-9684-60410ae83a86 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:08.705367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ad9291d7-2ab4-4033-9684-60410ae83a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:08.772290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 957/1881] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:08.780739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5596467-12e7-4683-b293-f0bc4d836076 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.781168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5596467-12e7-4683-b293-f0bc4d836076 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.781399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5596467-12e7-4683-b293-f0bc4d836076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.804035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c5596467-12e7-4683-b293-f0bc4d836076 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:08.805419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c5596467-12e7-4683-b293-f0bc4d836076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:08.815302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 925/1882] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:08.820990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9291d7-2ab4-4033-9684-60410ae83a86 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:08.831316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9291d7-2ab4-4033-9684-60410ae83a86 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:08.836270 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:08.836924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.837258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.837481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.838188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:08.838495 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:08.840112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:08.853220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 958/1883] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:08.857574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5596467-12e7-4683-b293-f0bc4d836076 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:08.868494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5596467-12e7-4683-b293-f0bc4d836076 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:08.873537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:08.874140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.874418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.874688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.875407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:08.877571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:08.908934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 926/1884] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:08 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:08.914468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:08.925443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77fde0-c93c-47b3-a132-fa6f97242f15 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:08.983762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:08.984375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:08.984700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:08.985558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:08.986197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:08.988261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:09.011622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 959/1885] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:08 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:13:09.012837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:09.022979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af916-dd99-4853-af53-aacebafb7e27 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:09.027969 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:09.028740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:09.029081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:09.029377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:09.030003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:09.032220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:09.042574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 927/1886] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:09.046530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:09.057466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648740-98df-4ac3-8f9d-5c376ad5d13a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:09.062232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7a759-8d36-4b0d-acfd-a458b5bef6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:09.062925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a759-8d36-4b0d-acfd-a458b5bef6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:09.063210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a759-8d36-4b0d-acfd-a458b5bef6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:09.063570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a759-8d36-4b0d-acfd-a458b5bef6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:09.064368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7a759-8d36-4b0d-acfd-a458b5bef6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:09.066097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7a759-8d36-4b0d-acfd-a458b5bef6a6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:09.076636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 960/1887] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:09.080803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:09.091525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b29e8-01d9-4a33-b341-2eeb031e28ee admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:09.096908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:09.097591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:09.097873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:09.098145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] PATH_INFO: `/v3/projects/a1aa24f99b90478e9b9b315576daf9bb/users/9d2ec2dff418461fb79f8dcd4c436f7c/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:09.114278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1aa24f99b90478e9b9b315576daf9bb, user_id=9d2ec2dff418461fb79f8dcd4c436f7c, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:09.117469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:09.130860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 928/1888] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:09 2022] PUT /identity/v3/projects/a1aa24f99b90478e9b9b315576daf9bb/users/9d2ec2dff418461fb79f8dcd4c436f7c/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:09.136071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:09.136358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:09.136632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:09.156238 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:09.157981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:09.230394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 961/1889] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:09.241629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:09.243621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:09.275510 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:09.315071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f30682-637a-490f-a484-8d302dbfe9a7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:09.319446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e598b-9b42-4167-8711-163ee2d5df9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:09.320060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e598b-9b42-4167-8711-163ee2d5df9b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:09.320335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e598b-9b42-4167-8711-163ee2d5df9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:09.320602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e598b-9b42-4167-8711-163ee2d5df9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:09.331681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e598b-9b42-4167-8711-163ee2d5df9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:09.333555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e598b-9b42-4167-8711-163ee2d5df9b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:09.345759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 929/1890] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:11.558418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:11.562087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:11.591192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e44c-3dda-4701-b2d9-893b86d20e0e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:11.597053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:11.597923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:11.598208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:11.598481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] PATH_INFO: `/v3/users/394a21d72dba4069b744d34495d5dee0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:11.599627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] RBAC: Authorizing `identity:delete_user(user_id=394a21d72dba4069b744d34495d5dee0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:11.601751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:11.603633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:11.660068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394a21d72dba4069b744d34495d5dee0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:11.668218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394a21d72dba4069b744d34495d5dee0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:11.675492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394a21d72dba4069b744d34495d5dee0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:11.676251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394a21d72dba4069b744d34495d5dee0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:11.693132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394a21d72dba4069b744d34495d5dee0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:11.710557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 962/1891] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:11 2022] DELETE /identity/v3/users/394a21d72dba4069b744d34495d5dee0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:11.715071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:11.715586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:11.715846 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:11.736285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:11.738119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:11.814953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 930/1892] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:11.825253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:11.826696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:11.908473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9728b5-954f-4c1d-923b-9ead213d742a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:11.913036 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32bd0f-d843-4216-8538-d8391a7bcaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:11.913844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bd0f-d843-4216-8538-d8391a7bcaca service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:11.914408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bd0f-d843-4216-8538-d8391a7bcaca service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:11.915414 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bd0f-d843-4216-8538-d8391a7bcaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:11.926554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32bd0f-d843-4216-8538-d8391a7bcaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:11.928141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32bd0f-d843-4216-8538-d8391a7bcaca service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:11.942486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 963/1893] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:12.925565 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:12.930719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:12.956735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284923a-07f2-45c4-9872-7e520d9611b6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:12.964655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:12.966332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:12.966874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:12.967302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] PATH_INFO: `/v3/projects/bce07244103d4861995e6074ac0aa7bf` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:12.970947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce07244103d4861995e6074ac0aa7bf)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:12.973433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.072628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce07244103d4861995e6074ac0aa7bf', 'request_id': 'req-8e2b9748-1958-4e13-9d79-a6cf3a300593'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:13.101575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce07244103d4861995e6074ac0aa7bf', 'request_id': 'req-8e2b9748-1958-4e13-9d79-a6cf3a300593'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:13.126581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce07244103d4861995e6074ac0aa7bf', 'request_id': 'req-8e2b9748-1958-4e13-9d79-a6cf3a300593'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:13.145125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] The token cache is being invalidate because project bce07244103d4861995e6074ac0aa7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:13.145666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:13.146842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8e2b9748-1958-4e13-9d79-a6cf3a300593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:13.151145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 931/1894] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:12 2022] DELETE /identity/v3/projects/bce07244103d4861995e6074ac0aa7bf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:13.156622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86767-148f-4954-acae-f7060841a42b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.157713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86767-148f-4954-acae-f7060841a42b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.158221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86767-148f-4954-acae-f7060841a42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.184465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c9e86767-148f-4954-acae-f7060841a42b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:13.186039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9e86767-148f-4954-acae-f7060841a42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:13.277550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 964/1895] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:13.281401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5ba67-4e64-4288-bb24-5b98495bfba6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.281858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5ba67-4e64-4288-bb24-5b98495bfba6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.282229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5ba67-4e64-4288-bb24-5b98495bfba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.310279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4fa5ba67-4e64-4288-bb24-5b98495bfba6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:13.311890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4fa5ba67-4e64-4288-bb24-5b98495bfba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:13.325033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 932/1896] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:13.327093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86767-148f-4954-acae-f7060841a42b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:13.338940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86767-148f-4954-acae-f7060841a42b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:13.345652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:13.346607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.347446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.348345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.349249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:13.349804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:13.352902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.373644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 965/1897] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:13.374243 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5ba67-4e64-4288-bb24-5b98495bfba6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:13.385964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5ba67-4e64-4288-bb24-5b98495bfba6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:13.391651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:13.392273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.392553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.392826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.393721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:13.395729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.433022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 933/1898] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:13 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:13.434643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:13.452675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1239-f820-481d-99fd-e9aa0d98f26b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:13.463091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:13.541129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:13.541749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.542031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.542308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.544738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:13.545935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.585870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 966/1899] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:13 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:13.590661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:13.623201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b09be-c63b-42f7-bcc3-f1eaf6baf52a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:13.641309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:13.642091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.642380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.642649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.643432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:13.645117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.663172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:13.664400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 934/1900] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:13:13.676193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5329d5-f7dc-4441-8ded-4f07196a3b96 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:13.682038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc676c-ae18-44d8-8625-2b29ab96f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:13.682826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc676c-ae18-44d8-8625-2b29ab96f180 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.683122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc676c-ae18-44d8-8625-2b29ab96f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.683401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc676c-ae18-44d8-8625-2b29ab96f180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.684206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc676c-ae18-44d8-8625-2b29ab96f180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:13.685879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc676c-ae18-44d8-8625-2b29ab96f180 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.702885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 967/1901] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:13.707692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:13.721738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18f53-f8a7-4069-8ddd-4cb8fc20ac83 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:13.726757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:13.727988 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.728274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.728552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] PATH_INFO: `/v3/projects/6c938a6a5f9e4ed9af35974ed3e1b693/users/933e375f3f54420f961bb34a1e66cc14/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.732692 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:13.755958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c938a6a5f9e4ed9af35974ed3e1b693, user_id=933e375f3f54420f961bb34a1e66cc14, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:13.759392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.780300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 935/1902] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:13 2022] PUT /identity/v3/projects/6c938a6a5f9e4ed9af35974ed3e1b693/users/933e375f3f54420f961bb34a1e66cc14/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:13.785873 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a223b-e107-47ee-92c6-6ee2b0af8eb4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.786171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a223b-e107-47ee-92c6-6ee2b0af8eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.786447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a223b-e107-47ee-92c6-6ee2b0af8eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.807731 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d74a223b-e107-47ee-92c6-6ee2b0af8eb4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:13.808954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d74a223b-e107-47ee-92c6-6ee2b0af8eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:13.887686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 968/1903] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:13.898463 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:13.900821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:13.967050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96700eb-31ea-46f4-861a-75bf88160f17 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:13.971479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:13.972158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:13.972913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:13.972913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:13.982483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:13.983995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:13.994193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 936/1904] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:13:15.399534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:15.400418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:15.400903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:15.432783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] MFA Rules not processed for user `933e375f3f54420f961bb34a1e66cc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:15.434418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:15.518568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 969/1905] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:15.529556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:15.531040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:15.625193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369af9-b313-4c85-a8a9-a5ed3cfdd2a3 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:15.641584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9105ae-036d-4340-9fde-5746d1d91010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:15.644201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9105ae-036d-4340-9fde-5746d1d91010 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:15.644764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9105ae-036d-4340-9fde-5746d1d91010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:15.645264 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9105ae-036d-4340-9fde-5746d1d91010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:15.663960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9105ae-036d-4340-9fde-5746d1d91010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:15.666020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9105ae-036d-4340-9fde-5746d1d91010 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:15.679828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 937/1906] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:17.281933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:17.283890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:17.306653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558f5cc-be0b-461d-a2eb-9906f26713dd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:17.317744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:17.318658 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:17.319121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:17.319547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] PATH_INFO: `/v3/users/024c459f1e804020a677ce8686f40a52` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:17.322325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024c459f1e804020a677ce8686f40a52)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:17.324487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:17.351976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:17.420793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024c459f1e804020a677ce8686f40a52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:17.424654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b9d0-24b6-484a-b594-8827daa78690 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:17.425566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b9d0-24b6-484a-b594-8827daa78690 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:17.426238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b9d0-24b6-484a-b594-8827daa78690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:17.471694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024c459f1e804020a677ce8686f40a52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:17.474930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024c459f1e804020a677ce8686f40a52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:17.479104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024c459f1e804020a677ce8686f40a52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:17.497509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-df69b9d0-24b6-484a-b594-8827daa78690 None None] MFA Rules not processed for user `933e375f3f54420f961bb34a1e66cc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:17.507531 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df69b9d0-24b6-484a-b594-8827daa78690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:17.529530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b5f10643-8157-4be8-a245-cf31d9ca9bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024c459f1e804020a677ce8686f40a52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:17.539244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 938/1907] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:17.556833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 970/1908] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:17 2022] DELETE /identity/v3/users/024c459f1e804020a677ce8686f40a52 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:17.561785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:17.563054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:17.563540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:17.604304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:17.606641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:17.748414 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:17.748704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:17.749020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:17.783532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 939/1909] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:17.800761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:17.802353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:17.803378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] MFA Rules not processed for user `9d2ec2dff418461fb79f8dcd4c436f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:17.804700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:17.862098 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:17.946124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e4db6-938e-4a61-a4d5-e6f6ae57f5d1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:17.950793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 971/1910] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:17.951811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:17.952548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:17.952834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:17.953695 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:17.956072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:17.959373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:17.981306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:17.983595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986bf0-fd2c-417b-b6a6-ca24c471bba9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:17.985093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:17.989513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:17.990145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:17.990440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:17.990697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:17.991401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:17.993620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:18.011821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 940/1911] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:18.039396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 972/1912] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:17 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:18.043017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:18.066906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ff4c5-c2d0-4a2b-89de-d34551dae3c6 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:18.179468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:18.180128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:18.180413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:18.181320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:18.181991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:18.184408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:18.210602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 941/1913] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:18 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:18.215042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:18.229025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a302e-5294-40a6-a414-bff599e27381 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:18.235226 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:18.235865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:18.236273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:18.236866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:18.237637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:18.239690 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:18.254520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 973/1914] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:18.258715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:18.279706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30684b97-2acb-498b-b24b-0692d0fba217 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:18.286362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:18.287045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:18.287324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:18.287665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] PATH_INFO: `/v3/projects/563c1a4066414796b0f1409afcfb527f/users/1b529ac1136e46d7a3647f378c4e5638/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:18.305202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=563c1a4066414796b0f1409afcfb527f, user_id=1b529ac1136e46d7a3647f378c4e5638, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:18.308204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:18.326717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 942/1915] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:18 2022] PUT /identity/v3/projects/563c1a4066414796b0f1409afcfb527f/users/1b529ac1136e46d7a3647f378c4e5638/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:13:18.331149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:18.344962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e0411-71ff-4f8a-9060-82fe067ac849 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:18.421667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:18.447186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:18.448069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:18.448788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:18.449556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:18.450427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:18.460365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:18.482469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 974/1916] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:18.486951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:18.510286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eef0a-3044-4cfc-b30f-46389ff1fdcc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:18.517887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ea3f-4c14-4f01-8615-4559b2c28d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:18.518857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ea3f-4c14-4f01-8615-4559b2c28d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:18.519777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ea3f-4c14-4f01-8615-4559b2c28d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:18.520293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ea3f-4c14-4f01-8615-4559b2c28d9a admin admin] PATH_INFO: `/v3/projects/563c1a4066414796b0f1409afcfb527f/users/1b529ac1136e46d7a3647f378c4e5638/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:18.522991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0ea3f-4c14-4f01-8615-4559b2c28d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=563c1a4066414796b0f1409afcfb527f, user_id=1b529ac1136e46d7a3647f378c4e5638, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:18.533112 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0ea3f-4c14-4f01-8615-4559b2c28d9a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:18.557294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 943/1917] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:18 2022] PUT /identity/v3/projects/563c1a4066414796b0f1409afcfb527f/users/1b529ac1136e46d7a3647f378c4e5638/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:13:18.685618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:18.689118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:18.740867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a963-0a65-494c-b7a0-2e8289866584 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:18.846874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:18.849269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:18.849701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:18.850120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] PATH_INFO: `/v3/projects/81179bda26e04acc9c6eb0560e893587` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:18.853418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=81179bda26e04acc9c6eb0560e893587)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:18.855504 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:18.926653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81179bda26e04acc9c6eb0560e893587', 'request_id': 'req-0638378d-b520-462b-8ca4-b9a76b4a67ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:18.945981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81179bda26e04acc9c6eb0560e893587', 'request_id': 'req-0638378d-b520-462b-8ca4-b9a76b4a67ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:18.958325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81179bda26e04acc9c6eb0560e893587', 'request_id': 'req-0638378d-b520-462b-8ca4-b9a76b4a67ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:18.986376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] The token cache is being invalidate because project 81179bda26e04acc9c6eb0560e893587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:18.986376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:18.988126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0638378d-b520-462b-8ca4-b9a76b4a67ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:18.990479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 975/1918] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:18 2022] DELETE /identity/v3/projects/81179bda26e04acc9c6eb0560e893587 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:18.995275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6335b-f741-4896-9556-78c010158025 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:18.995559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6335b-f741-4896-9556-78c010158025 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:18.996292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6335b-f741-4896-9556-78c010158025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.035762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e6b6335b-f741-4896-9556-78c010158025 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:19.038509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e6b6335b-f741-4896-9556-78c010158025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:19.163950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d41ab-7f00-4b94-8c9c-b04f3ad803d3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.164396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d41ab-7f00-4b94-8c9c-b04f3ad803d3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.164793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d41ab-7f00-4b94-8c9c-b04f3ad803d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.170836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 944/1919] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:19.198432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-766d41ab-7f00-4b94-8c9c-b04f3ad803d3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:19.199923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-766d41ab-7f00-4b94-8c9c-b04f3ad803d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:19.213555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 976/1920] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:19.217780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6335b-f741-4896-9556-78c010158025 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:19.230124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6335b-f741-4896-9556-78c010158025 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:19.238316 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:19.240294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.240868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.241377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.242427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:19.243825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:19.245876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:19.265031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 945/1921] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:19.266705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d41ab-7f00-4b94-8c9c-b04f3ad803d3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:19.289693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d41ab-7f00-4b94-8c9c-b04f3ad803d3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:19.296874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:19.298880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.299230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.299604 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.300314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:19.302999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:19.370747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 977/1922] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:19 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:19.377599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:19.390391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae79a-defd-4d62-a5ce-5710e2e1ef05 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:19.400122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:19.523782 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:19.524548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.524841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.525917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.526582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:19.530674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:19.561698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 946/1923] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:19 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:13:19.566780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:19.601270 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6dac-6d27-4ca6-a2f2-32a6abea5448 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:19.614734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:19.615382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.615646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.615922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.616570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:19.618717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:19.635263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 978/1924] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:19.639191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:19.654146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b3b3-c470-4679-bcf1-7f37e0f8880b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:19.660272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98b3a3-1344-4ffe-b169-0b6c80a2524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:19.661163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b3a3-1344-4ffe-b169-0b6c80a2524b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.661448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b3a3-1344-4ffe-b169-0b6c80a2524b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.661720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98b3a3-1344-4ffe-b169-0b6c80a2524b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.662363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98b3a3-1344-4ffe-b169-0b6c80a2524b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:19.663962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98b3a3-1344-4ffe-b169-0b6c80a2524b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:19.680517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 947/1925] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:19.684248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:19.713895 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c50df-1304-4146-8b12-d012be1fba65 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:19.731149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:19.734665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.735128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.735533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] PATH_INFO: `/v3/projects/141ad46956a644e5830931171f7b762e/users/10defd6be9964cccb94bb6f896450466/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.753570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141ad46956a644e5830931171f7b762e, user_id=10defd6be9964cccb94bb6f896450466, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:19.757241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:19.774898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 979/1926] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:19 2022] PUT /identity/v3/projects/141ad46956a644e5830931171f7b762e/users/10defd6be9964cccb94bb6f896450466/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:13:19.786784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a1f21-c203-4fb7-a446-ad61190f492f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:19.787479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a1f21-c203-4fb7-a446-ad61190f492f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:19.787843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a1f21-c203-4fb7-a446-ad61190f492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:19.828156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-453a1f21-c203-4fb7-a446-ad61190f492f None None] MFA Rules not processed for user `10defd6be9964cccb94bb6f896450466`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:19.829955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-453a1f21-c203-4fb7-a446-ad61190f492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:20.009598 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 948/1927] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:20.011076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:20.035249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:20.191057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60401e-0ad4-481e-a9f1-028e41831707 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:20.205227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:20.205869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:20.206150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:20.206424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:20.207063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:20.209009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:20.271066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 980/1928] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:20.274971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a1f21-c203-4fb7-a446-ad61190f492f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:20.290990 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a1f21-c203-4fb7-a446-ad61190f492f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:20.386295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:20.387078 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:20.387501 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:20.387868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:20.388621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:20.391870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:20.428308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 949/1929] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:20 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:13:20.432266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:20.446667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe23a7-28fa-4ef0-b966-0730648c9472 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:20.471625 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:20.472280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:20.472561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:20.472834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:20.473517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:20.478089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:20.506165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:20.508181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 981/1930] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:13:20.518932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:20.529222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287a11c-4010-4f60-b68d-4fe0123ef238 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:20.539874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8026658-1021-48a1-9e51-aa898765f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:20.540902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8026658-1021-48a1-9e51-aa898765f212 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:20.541647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8026658-1021-48a1-9e51-aa898765f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:20.542274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8026658-1021-48a1-9e51-aa898765f212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:20.543716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8026658-1021-48a1-9e51-aa898765f212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:20.546721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8026658-1021-48a1-9e51-aa898765f212 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:20.561248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 950/1931] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:13:20.565327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:20.577215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3953590-4745-4867-bb5f-fa17d447ee79 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:20.582645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:20.583643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:20.584137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:20.584630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] PATH_INFO: `/v3/projects/a4216d09395647a78ef7d5aa0f5e282f/users/d8a8125cc4134ea88d8cb077be791198/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:20.614461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4216d09395647a78ef7d5aa0f5e282f, user_id=d8a8125cc4134ea88d8cb077be791198, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:20.619907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:20.652169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 982/1932] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:20 2022] PUT /identity/v3/projects/a4216d09395647a78ef7d5aa0f5e282f/users/d8a8125cc4134ea88d8cb077be791198/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:20.654233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415182-86d3-457f-95a9-212cc4ba66bd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:20.654740 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415182-86d3-457f-95a9-212cc4ba66bd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:20.655228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415182-86d3-457f-95a9-212cc4ba66bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:20.691456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5b415182-86d3-457f-95a9-212cc4ba66bd None None] MFA Rules not processed for user `d8a8125cc4134ea88d8cb077be791198`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:20.694327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5b415182-86d3-457f-95a9-212cc4ba66bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:20.827148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 951/1933] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:20.832400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:20.974074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c609be0-75f9-4260-a3b1-88657c1985fb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:20.989868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:20.990727 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:20.991143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:20.991573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:20.992367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:20.999297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:21.084517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 983/1934] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:20 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:13:21.087912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b415182-86d3-457f-95a9-212cc4ba66bd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:21.112757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b415182-86d3-457f-95a9-212cc4ba66bd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:21.256580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:21.257252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:21.257535 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:21.258322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:21.259017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:21.261067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:21.309370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 952/1935] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:21 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:21.310362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:21.329878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28173c-f5d6-4fd2-a8bc-a3369574dcc2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:21.345891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:21.348583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:21.348967 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:21.350096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:21.353016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:21.360521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:21.389401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:21.393213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 984/1936] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:21.411747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daa513-d898-4fb4-b605-1ba716abab49 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:21.419064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:21.420782 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:21.421132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:21.421407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] PATH_INFO: `/v3/projects/373585ecc81542dabb2c6ebc1ff280e7/users/26d1b18a410d446386369690d19d080c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:21.463871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373585ecc81542dabb2c6ebc1ff280e7, user_id=26d1b18a410d446386369690d19d080c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:21.470636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:21.517861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 953/1937] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:21 2022] PUT /identity/v3/projects/373585ecc81542dabb2c6ebc1ff280e7/users/26d1b18a410d446386369690d19d080c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:13:21.519020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:21.537627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d857f1e-a341-4ac8-ba4c-0ebed5a43ac5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:21.646312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:21.804072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacce95-e351-49f0-8e95-b167f0783c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:21.805332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacce95-e351-49f0-8e95-b167f0783c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:21.805873 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacce95-e351-49f0-8e95-b167f0783c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:21.806342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacce95-e351-49f0-8e95-b167f0783c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:21.807567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacce95-e351-49f0-8e95-b167f0783c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:21.810467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacce95-e351-49f0-8e95-b167f0783c13 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:21.849090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 985/1938] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:21.853486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:21.871676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7271cb0-1976-4f6b-bf96-fc677e7ccf16 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:21.888158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:21.891520 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:21.893192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:21.893562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] PATH_INFO: `/v3/projects/373585ecc81542dabb2c6ebc1ff280e7/users/26d1b18a410d446386369690d19d080c/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:21.909047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=373585ecc81542dabb2c6ebc1ff280e7, user_id=26d1b18a410d446386369690d19d080c, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:21.926694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:21.970101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 954/1939] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:21 2022] PUT /identity/v3/projects/373585ecc81542dabb2c6ebc1ff280e7/users/26d1b18a410d446386369690d19d080c/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:21.971600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:21.971890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:21.972163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:22.046014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] MFA Rules not processed for user `26d1b18a410d446386369690d19d080c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:22.047336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:22.180193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 986/1940] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:22.195883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:22.199331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:22.316753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:22.362002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8fb16-e638-45d0-be71-8d4c87bf0f9d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:22.366850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:22.367484 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:22.367764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:22.368160 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:22.463070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:22.464803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:22.481981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 955/1941] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:24.445531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:24.447233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:24.468259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88c3cb-2d04-4489-9d5e-f98566cb0b88 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:24.476851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ec715-2b47-4524-9ec6-462a8d147790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:24.478088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec715-2b47-4524-9ec6-462a8d147790 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:24.478442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec715-2b47-4524-9ec6-462a8d147790 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:24.479059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec715-2b47-4524-9ec6-462a8d147790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:24.582616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec715-2b47-4524-9ec6-462a8d147790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:24.584462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec715-2b47-4524-9ec6-462a8d147790 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:24.597420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 987/1942] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:25.352534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:25.363702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476359f9-bdc9-4a52-8cdb-79012b15d5ae service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:25.368246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:25.369124 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:25.369725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:25.370936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:25.382935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:25.384488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:25.411657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 956/1943] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:26.838215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e0f5-3eb1-42c1-9ca2-c190d07e0ed7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:26.838723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e0f5-3eb1-42c1-9ca2-c190d07e0ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:26.838820 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e0f5-3eb1-42c1-9ca2-c190d07e0ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:26.874760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e6b6e0f5-3eb1-42c1-9ca2-c190d07e0ed7 None None] MFA Rules not processed for user `1b529ac1136e46d7a3647f378c4e5638`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:26.875981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e6b6e0f5-3eb1-42c1-9ca2-c190d07e0ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:26.957119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:27.001238 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 988/1944] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:27.015204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:27.025374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:27.216855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6b5a9-04ae-438f-a282-2e3a1cf5ea54 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:27.222076 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:27.222831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:27.223212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:27.223646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:27.225665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:27.336224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:27.338771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:27.349280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 957/1945] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:27.623038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f081e79-a5cb-4a03-a6a5-26af3fa875a2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:27.623392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f081e79-a5cb-4a03-a6a5-26af3fa875a2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:27.623911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f081e79-a5cb-4a03-a6a5-26af3fa875a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:27.666269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4f081e79-a5cb-4a03-a6a5-26af3fa875a2 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:27.667640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4f081e79-a5cb-4a03-a6a5-26af3fa875a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:27.795979 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 989/1946] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:13:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:27.862189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:27.863631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:27.882916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:27.951901 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574efce-6e10-4225-ba97-5ee155a835db service glance] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:27.958630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:27.959192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:27.959953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:27.959953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:27.969558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:27.971377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:28.002096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 958/1947] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:13:28.210828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f65cc-2a97-4f66-8d09-0a29155d6111 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:28.214841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f65cc-2a97-4f66-8d09-0a29155d6111 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:28.215144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f65cc-2a97-4f66-8d09-0a29155d6111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:28.250788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e83f65cc-2a97-4f66-8d09-0a29155d6111 None None] MFA Rules not processed for user `10e74aaba7cc4b038b5028a76e78feab`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:28.252065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e83f65cc-2a97-4f66-8d09-0a29155d6111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:28.371730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 990/1948] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:29.979093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:30.112649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f91d47-5073-49db-916f-094b70b3018e service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:30.118369 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:30.119315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:30.119664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:30.120415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] PATH_INFO: `/v3/users/10defd6be9964cccb94bb6f896450466` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:30.122768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10defd6be9964cccb94bb6f896450466)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:30.126659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:30.216440 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10defd6be9964cccb94bb6f896450466'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:30.217205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10defd6be9964cccb94bb6f896450466'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:30.230615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10defd6be9964cccb94bb6f896450466'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:30.231348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10defd6be9964cccb94bb6f896450466'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:30.274631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10defd6be9964cccb94bb6f896450466'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:30.315343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 959/1949] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:29 2022] DELETE /identity/v3/users/10defd6be9964cccb94bb6f896450466 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:30.320019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:30.320993 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:30.321474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:30.374224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:30.374224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:30.550783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 991/1950] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:30.573738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:30.575384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:30.628134 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:30.752365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569bf5-a69d-48c2-b711-9367865acf4a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:30.756835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:30.757517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:30.757797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:30.758930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:30.773654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:30.775946 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:30.815957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 960/1951] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:31.409669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:31.411775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:31.433570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a45b1-08ab-4b7d-9a3b-d30e1d8c6937 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:31.441661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:31.442402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:31.442766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:31.443725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] PATH_INFO: `/v3/projects/141ad46956a644e5830931171f7b762e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:31.444959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141ad46956a644e5830931171f7b762e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:31.447537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:31.494831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:31.534161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141ad46956a644e5830931171f7b762e', 'request_id': 'req-6108afd4-f90a-45f3-81aa-37932a2c1504'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.544755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141ad46956a644e5830931171f7b762e', 'request_id': 'req-6108afd4-f90a-45f3-81aa-37932a2c1504'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.557913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141ad46956a644e5830931171f7b762e', 'request_id': 'req-6108afd4-f90a-45f3-81aa-37932a2c1504'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.574100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] The token cache is being invalidate because project 141ad46956a644e5830931171f7b762e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:31.574631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.576087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.581880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 992/1952] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:31 2022] DELETE /identity/v3/projects/141ad46956a644e5830931171f7b762e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:31.585882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:31.599376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100923-32eb-48c2-8083-de84fd8d7499 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:31.782602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:31.783671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:31.784087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:31.784530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] PATH_INFO: `/v3/users/d8a8125cc4134ea88d8cb077be791198` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:31.789020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a8125cc4134ea88d8cb077be791198)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:31.804670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:31.961457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a8125cc4134ea88d8cb077be791198'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.962227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a8125cc4134ea88d8cb077be791198'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.979344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a8125cc4134ea88d8cb077be791198'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:31.980131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a8125cc4134ea88d8cb077be791198'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:32.006512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a8125cc4134ea88d8cb077be791198'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:32.027500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 961/1953] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:31 2022] DELETE /identity/v3/users/d8a8125cc4134ea88d8cb077be791198 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:32.918140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:32.920013 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:32.944678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108afd4-f90a-45f3-81aa-37932a2c1504 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:33.175088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:33.175708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:33.178055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:33.178368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] PATH_INFO: `/v3/projects/a4216d09395647a78ef7d5aa0f5e282f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:33.183303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4216d09395647a78ef7d5aa0f5e282f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:33.186033 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:33.295819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4216d09395647a78ef7d5aa0f5e282f', 'request_id': 'req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.307022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4216d09395647a78ef7d5aa0f5e282f', 'request_id': 'req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.314618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4216d09395647a78ef7d5aa0f5e282f', 'request_id': 'req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.336040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] The token cache is being invalidate because project a4216d09395647a78ef7d5aa0f5e282f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:33.336701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.337631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.339650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 993/1954] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:32 2022] DELETE /identity/v3/projects/a4216d09395647a78ef7d5aa0f5e282f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:33.343994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:33.345533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:33.365040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f46f1-7dcc-404c-afeb-9adcf830ebf2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:33.439603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:33.521263 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:33.522246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:33.523970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:33.524519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] PATH_INFO: `/v3/users/26d1b18a410d446386369690d19d080c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:33.528105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d1b18a410d446386369690d19d080c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:33.538808 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:33.676723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d1b18a410d446386369690d19d080c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.677111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d1b18a410d446386369690d19d080c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.705568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d1b18a410d446386369690d19d080c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.706913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d1b18a410d446386369690d19d080c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.754405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-628434d7-cf3b-47c2-963c-9828dd64849d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d1b18a410d446386369690d19d080c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:33.781376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 962/1955] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:13:33 2022] DELETE /identity/v3/users/26d1b18a410d446386369690d19d080c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:34.353407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:34.355673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:34.387324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2feeb56-9e81-4a42-b9bd-e9d1503c8b31 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:34.520181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:34.549531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:34.551371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:34.551883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:34.553529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] PATH_INFO: `/v3/projects/373585ecc81542dabb2c6ebc1ff280e7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:34.558068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=373585ecc81542dabb2c6ebc1ff280e7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:34.561261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:34.629354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373585ecc81542dabb2c6ebc1ff280e7', 'request_id': 'req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:34.641553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373585ecc81542dabb2c6ebc1ff280e7', 'request_id': 'req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:34.649433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373585ecc81542dabb2c6ebc1ff280e7', 'request_id': 'req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:34.663376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] The token cache is being invalidate because project 373585ecc81542dabb2c6ebc1ff280e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:13:34.663672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:34.664462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a2c401a-cfb7-463f-b83f-6478edbcf8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:13:34.669818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 994/1956] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:13:34 2022] DELETE /identity/v3/projects/373585ecc81542dabb2c6ebc1ff280e7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:34.675741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f3227-2b5d-48a1-8492-37276f8d2cbf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:34.676275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f3227-2b5d-48a1-8492-37276f8d2cbf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:34.676275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f3227-2b5d-48a1-8492-37276f8d2cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:34.704146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2c7f3227-2b5d-48a1-8492-37276f8d2cbf None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:34.705480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2c7f3227-2b5d-48a1-8492-37276f8d2cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:34.805671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 963/1957] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:34.806057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa510e-9154-45e2-bbc1-f16b93572b0f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:34.806057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa510e-9154-45e2-bbc1-f16b93572b0f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:34.806057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa510e-9154-45e2-bbc1-f16b93572b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:34.851922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-75fa510e-9154-45e2-bbc1-f16b93572b0f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:34.853456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75fa510e-9154-45e2-bbc1-f16b93572b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:34.876903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 995/1958] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:34.878281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f3227-2b5d-48a1-8492-37276f8d2cbf None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:34.890010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f3227-2b5d-48a1-8492-37276f8d2cbf None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:34.899396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:34.900301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:34.900595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:34.900884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:34.901573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:13:34.901881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:34.903625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:34.935701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 964/1959] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:13:34.940651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa510e-9154-45e2-bbc1-f16b93572b0f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:34.950661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa510e-9154-45e2-bbc1-f16b93572b0f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:34.956369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:34.957088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:34.957381 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:34.957655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:34.958291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:34.960316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:35.013846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 996/1960] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:13:34 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:13:35.014536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:35.033039 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b1479-ea7e-4f2f-af2d-8f30af7ab41d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:35.111948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:35.129579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:35.130985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:35.131282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:35.131540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:35.132189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:35.134469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:35.178864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 965/1961] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:13:35 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:13:35.182951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:35.195487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4a634-f50b-4216-9813-7fc735a1a6ba admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:35.202037 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:35.203211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:35.203510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:35.203772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:35.207075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:35.209677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:35.226178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 997/1962] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:35.229807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:35.243361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b4aee-7bdd-45ee-85f9-1b9d868bb9a5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:35.248537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaac71-f2f5-46f9-a491-36648a008ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:35.250055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaac71-f2f5-46f9-a491-36648a008ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:35.250345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaac71-f2f5-46f9-a491-36648a008ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:35.250963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaac71-f2f5-46f9-a491-36648a008ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:35.251616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaac71-f2f5-46f9-a491-36648a008ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:35.271691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaac71-f2f5-46f9-a491-36648a008ccd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:35.297499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 966/1963] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:13:35.301557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:35.320321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c01df-2bc5-4667-bd90-71a6a5ef5f2c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:35.332939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:35.333664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:35.333947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:35.334224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] PATH_INFO: `/v3/projects/e8701c841597463b87f36cd0b9dd25c3/users/4e8165ee955a4f74b7f95f3b8972fe04/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:35.359705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8701c841597463b87f36cd0b9dd25c3, user_id=4e8165ee955a4f74b7f95f3b8972fe04, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:35.362496 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:35.379914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 998/1964] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:13:35 2022] PUT /identity/v3/projects/e8701c841597463b87f36cd0b9dd25c3/users/4e8165ee955a4f74b7f95f3b8972fe04/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:13:35.389341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54a69-f16d-4e8f-8cea-d89bc72bf5cd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:35.389865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54a69-f16d-4e8f-8cea-d89bc72bf5cd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:35.390163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54a69-f16d-4e8f-8cea-d89bc72bf5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:35.428201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-86a54a69-f16d-4e8f-8cea-d89bc72bf5cd None None] MFA Rules not processed for user `4e8165ee955a4f74b7f95f3b8972fe04`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:35.429612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-86a54a69-f16d-4e8f-8cea-d89bc72bf5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:35.522815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 967/1965] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:35.535233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:35.537055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:35.668521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7e071-f4f8-4aba-a060-0f3b1d5adb9c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:35.674019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4ee4f-2ffb-465b-9fb2-97395af16613 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:35.674242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ee4f-2ffb-465b-9fb2-97395af16613 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:35.674530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ee4f-2ffb-465b-9fb2-97395af16613 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:35.674808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4ee4f-2ffb-465b-9fb2-97395af16613 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:35.686572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4ee4f-2ffb-465b-9fb2-97395af16613 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:35.688677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4ee4f-2ffb-465b-9fb2-97395af16613 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:35.700794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 999/1966] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:42.420842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:42.421522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:42.421522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:42.441017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] MFA Rules not processed for user `9d2ec2dff418461fb79f8dcd4c436f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:42.442171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:42.502656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 968/1967] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:13:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:13:45.694449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:51.575278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b70cb-a4ca-455b-963e-2efb9526510b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:51.576309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b70cb-a4ca-455b-963e-2efb9526510b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:51.576758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b70cb-a4ca-455b-963e-2efb9526510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:51.601058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d76b70cb-a4ca-455b-963e-2efb9526510b None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:51.602834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d76b70cb-a4ca-455b-963e-2efb9526510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:51.678347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1000/1968] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:51.685654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:51.687113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:51.774797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:51.780365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a76ae0-905a-46b3-bd86-cfda7b157bc6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:51.789785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:51.790431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:51.790735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:51.790972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:51.799571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:51.801172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:51.809340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 969/1969] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:13:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:13:57.550418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6d77b-8fd5-41da-8b4e-d4322ce0f585 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:57.551303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6d77b-8fd5-41da-8b4e-d4322ce0f585 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:57.551587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6d77b-8fd5-41da-8b4e-d4322ce0f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:57.572407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-00c6d77b-8fd5-41da-8b4e-d4322ce0f585 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:57.573925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-00c6d77b-8fd5-41da-8b4e-d4322ce0f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:57.593285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1001/1970] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:13:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:57.607303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:57.618930 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e41258-39f2-44b0-a3ff-50141473966b service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:57.624759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184762e2-b157-47b2-8673-3b628d0f464e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:57.625424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184762e2-b157-47b2-8673-3b628d0f464e service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:57.625704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184762e2-b157-47b2-8673-3b628d0f464e service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:57.625978 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184762e2-b157-47b2-8673-3b628d0f464e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:57.635555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184762e2-b157-47b2-8673-3b628d0f464e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:57.637254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184762e2-b157-47b2-8673-3b628d0f464e service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:57.646651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 970/1971] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 02:14:07.566627 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=28 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:07.643617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:15.192536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6d77b-8fd5-41da-8b4e-d4322ce0f585 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:15.268807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6d77b-8fd5-41da-8b4e-d4322ce0f585 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:15.283904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:15.284667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:15.285045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:15.285893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] PATH_INFO: `/v3/users/4e8165ee955a4f74b7f95f3b8972fe04` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:15.287203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8165ee955a4f74b7f95f3b8972fe04)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:15.289262 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:15.343094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8165ee955a4f74b7f95f3b8972fe04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.350643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8165ee955a4f74b7f95f3b8972fe04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.351437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8165ee955a4f74b7f95f3b8972fe04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.352328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8165ee955a4f74b7f95f3b8972fe04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.365546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8165ee955a4f74b7f95f3b8972fe04'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.378785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1002/1972] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:14:15 2022] DELETE /identity/v3/users/4e8165ee955a4f74b7f95f3b8972fe04 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:14:15.383260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:15.383748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:15.383856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:15.403176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:15.404368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:15.465596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 971/1973] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:15.475247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:15.476674 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:15.533030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3c59-6fea-43af-b6aa-ceb701e2f2d3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:15.536617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8649443-41ee-487a-a4b7-2e638b59514d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:15.537260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8649443-41ee-487a-a4b7-2e638b59514d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:15.537540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8649443-41ee-487a-a4b7-2e638b59514d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:15.537811 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8649443-41ee-487a-a4b7-2e638b59514d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:15.546678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8649443-41ee-487a-a4b7-2e638b59514d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:15.548104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8649443-41ee-487a-a4b7-2e638b59514d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:15.557797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1003/1974] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:15.843847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:15.845445 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:15.860374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afffe4e-5d35-41fe-9412-ccda3c44faad None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:15.866305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:15.867214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:15.867214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:15.867513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] PATH_INFO: `/v3/projects/e8701c841597463b87f36cd0b9dd25c3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:15.868655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8701c841597463b87f36cd0b9dd25c3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:15.870622 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:15.927679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8701c841597463b87f36cd0b9dd25c3', 'request_id': 'req-172a7b4b-1d04-471e-8479-26865cb43249'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.933837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8701c841597463b87f36cd0b9dd25c3', 'request_id': 'req-172a7b4b-1d04-471e-8479-26865cb43249'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.942961 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8701c841597463b87f36cd0b9dd25c3', 'request_id': 'req-172a7b4b-1d04-471e-8479-26865cb43249'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.956769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] The token cache is being invalidate because project e8701c841597463b87f36cd0b9dd25c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:14:15.957185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.957926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:14:15.959430 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 972/1975] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:14:15 2022] DELETE /identity/v3/projects/e8701c841597463b87f36cd0b9dd25c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:14:16.954186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb77f-2716-48a3-a752-13ea546adef7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:16.954726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb77f-2716-48a3-a752-13ea546adef7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:16.954917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceb77f-2716-48a3-a752-13ea546adef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:16.974532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-37ceb77f-2716-48a3-a752-13ea546adef7 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:16.975725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37ceb77f-2716-48a3-a752-13ea546adef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:16.994859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:17.043763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1004/1976] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:17.070467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:17.072908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:17.171756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7b4b-1d04-471e-8479-26865cb43249 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:17.177530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64166-55f2-445b-b71e-cdf18e775116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:17.178149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64166-55f2-445b-b71e-cdf18e775116 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:17.178431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64166-55f2-445b-b71e-cdf18e775116 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:17.178730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64166-55f2-445b-b71e-cdf18e775116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:17.188186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64166-55f2-445b-b71e-cdf18e775116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:17.189870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64166-55f2-445b-b71e-cdf18e775116 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:17.201573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 973/1977] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:17.803528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7982d28-0880-4d6f-939b-82d4309a7b13 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:17.803812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7982d28-0880-4d6f-939b-82d4309a7b13 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:17.804086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7982d28-0880-4d6f-939b-82d4309a7b13 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:17.805498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1005/1978] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:14:17.812167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610156c-96ad-456b-b2ff-f25f2276bc73 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:17.812456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610156c-96ad-456b-b2ff-f25f2276bc73 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:17.812730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610156c-96ad-456b-b2ff-f25f2276bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:17.834918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e610156c-96ad-456b-b2ff-f25f2276bc73 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:17.836133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e610156c-96ad-456b-b2ff-f25f2276bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:17.845791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 974/1979] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:14:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:17.857948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7982d28-0880-4d6f-939b-82d4309a7b13 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:17.860291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d7982d28-0880-4d6f-939b-82d4309a7b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:17.919908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7982d28-0880-4d6f-939b-82d4309a7b13 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:17.924122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c2a2-cc0f-4508-a9d4-830322826d1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:17.924800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c2a2-cc0f-4508-a9d4-830322826d1b service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:17.925181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c2a2-cc0f-4508-a9d4-830322826d1b service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:17.925512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c2a2-cc0f-4508-a9d4-830322826d1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:17.945074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4c2a2-cc0f-4508-a9d4-830322826d1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:17.945074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4c2a2-cc0f-4508-a9d4-830322826d1b service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:17.948826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1006/1980] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:18.016729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3638-3cff-47d1-ac87-22043d995fbb None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:18.017047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3638-3cff-47d1-ac87-22043d995fbb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:18.017326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3638-3cff-47d1-ac87-22043d995fbb None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:18.018681 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 975/1981] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:14:18.023409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc48a-77f3-4467-bf54-077463bbc114 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:18.023857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc48a-77f3-4467-bf54-077463bbc114 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:18.023978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc48a-77f3-4467-bf54-077463bbc114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:18.043186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-40fcc48a-77f3-4467-bf54-077463bbc114 None None] MFA Rules not processed for user `1dc28ef7b36746208560692b17809e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:18.044368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-40fcc48a-77f3-4467-bf54-077463bbc114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:18.093795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1007/1982] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:14:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:18.105688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c3638-3cff-47d1-ac87-22043d995fbb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:18.107429 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-163c3638-3cff-47d1-ac87-22043d995fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:18.115795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:18.124804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c3638-3cff-47d1-ac87-22043d995fbb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:18.128597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f34b1-42b4-41ba-9da6-9b0bca67ac41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:18.129238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f34b1-42b4-41ba-9da6-9b0bca67ac41 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:18.129521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f34b1-42b4-41ba-9da6-9b0bca67ac41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:18.129796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f34b1-42b4-41ba-9da6-9b0bca67ac41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:18.136937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f34b1-42b4-41ba-9da6-9b0bca67ac41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:18.138408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f34b1-42b4-41ba-9da6-9b0bca67ac41 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:18.146143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 976/1983] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:18.229086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450eed0-0490-4299-9ee1-8cab8290b3f1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:18.229373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450eed0-0490-4299-9ee1-8cab8290b3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:18.229647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450eed0-0490-4299-9ee1-8cab8290b3f1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:18.231002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1008/1984] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:14:18.236725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c83b-6c28-4c88-a1ff-fd9de6406c65 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:18.237043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c83b-6c28-4c88-a1ff-fd9de6406c65 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:18.237322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c83b-6c28-4c88-a1ff-fd9de6406c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:18.256563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1132c83b-6c28-4c88-a1ff-fd9de6406c65 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:18.257778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1132c83b-6c28-4c88-a1ff-fd9de6406c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:18.266879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 977/1985] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:14:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:18.277019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450eed0-0490-4299-9ee1-8cab8290b3f1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:18.288300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450eed0-0490-4299-9ee1-8cab8290b3f1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:18.291864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:18.292455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:18.292735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:18.293038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:18.303549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:18.304996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:18.315476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1009/1986] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:21.064397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f381f57-aec1-4804-8a2c-aa5c45b248d0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:21.064913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f381f57-aec1-4804-8a2c-aa5c45b248d0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:21.064913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f381f57-aec1-4804-8a2c-aa5c45b248d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:21.085810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8f381f57-aec1-4804-8a2c-aa5c45b248d0 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:21.087000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8f381f57-aec1-4804-8a2c-aa5c45b248d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:21.095223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 978/1987] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:21.117051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:21.118592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:21.134634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bed6f-7bc8-4cf7-b61c-7b7e612981e6 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:21.141338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:21.141954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:21.142232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:21.142502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:21.151866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:21.153469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:21.163392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1010/1988] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:25.308691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:25.309221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:25.309317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:25.329318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:25.330603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:25.338832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 979/1989] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:25.366591 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:25.380715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0bb5-9f75-4995-83b3-01dac954758f service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:25.386368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ccc89-83fb-4d7a-995d-36bd5e9b42ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:25.386976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ccc89-83fb-4d7a-995d-36bd5e9b42ab service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:25.387258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ccc89-83fb-4d7a-995d-36bd5e9b42ab service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:25.387531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ccc89-83fb-4d7a-995d-36bd5e9b42ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:25.396635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ccc89-83fb-4d7a-995d-36bd5e9b42ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:25.398246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ccc89-83fb-4d7a-995d-36bd5e9b42ab service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:25.408804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1011/1990] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:25.651246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:25.652630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:25.726070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa217d-cfb2-4720-90e3-02f95628d461 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:25.732704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:25.733393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:25.733670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:25.733941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:25.736088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:25.749428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:25.751448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:25.761986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 980/1991] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:28.397187 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b553-5594-4095-b29a-dc922cb7887a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:28.397598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b553-5594-4095-b29a-dc922cb7887a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:28.397733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b553-5594-4095-b29a-dc922cb7887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:28.426247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5237b553-5594-4095-b29a-dc922cb7887a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:28.427467 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5237b553-5594-4095-b29a-dc922cb7887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:28.445411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1012/1992] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:28.479147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:28.492318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbee4a-5de0-46cb-8ba4-5d11b4fffd4b service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:28.499516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6c22f-b9cb-4083-a2fa-dd56160347a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:28.500132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6c22f-b9cb-4083-a2fa-dd56160347a2 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:28.500409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6c22f-b9cb-4083-a2fa-dd56160347a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:28.500680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6c22f-b9cb-4083-a2fa-dd56160347a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:28.510367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6c22f-b9cb-4083-a2fa-dd56160347a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:28.511968 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6c22f-b9cb-4083-a2fa-dd56160347a2 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:28.529359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 981/1993] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:31.410360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b553-5594-4095-b29a-dc922cb7887a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:31.420306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b553-5594-4095-b29a-dc922cb7887a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:31.424039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:31.424639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:31.424914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:31.425275 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:31.426971 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:31.458100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:31.498997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:31.500703 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:31.510402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1013/1994] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:32.200866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3543caf-af3a-4703-bc5c-8c5d3f1d1350 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:32.202031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3543caf-af3a-4703-bc5c-8c5d3f1d1350 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:32.202548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3543caf-af3a-4703-bc5c-8c5d3f1d1350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:32.240578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f3543caf-af3a-4703-bc5c-8c5d3f1d1350 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:32.241819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f3543caf-af3a-4703-bc5c-8c5d3f1d1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:32.302017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 982/1995] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:14:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:14:32.324010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:32.325486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:32.398008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa835-36e7-451a-a5b8-2f06d0785400 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:32.402953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:32.403569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:32.403847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:32.404121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:32.412705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:32.414368 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:32.423025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1014/1996] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:14:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:14:32.684024 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3d9b0-6529-48e7-b3e3-23ad8983230d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:32.684677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3d9b0-6529-48e7-b3e3-23ad8983230d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:32.685198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3d9b0-6529-48e7-b3e3-23ad8983230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:32.722466 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f0a3d9b0-6529-48e7-b3e3-23ad8983230d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:32.723848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f0a3d9b0-6529-48e7-b3e3-23ad8983230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:32.734723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 983/1997] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:32.762805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:32.801489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687738-165a-4fe8-82f9-aad6c249b0ba service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:32.817308 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:32.818302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:32.820207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:32.820679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:32.839119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:32.841624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:32.880178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1015/1998] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:42.709596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=80 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:42.858783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=55 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:49.338058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458aca-954f-4ec7-84d6-d37dbacdbadd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:49.338639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458aca-954f-4ec7-84d6-d37dbacdbadd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:49.338639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458aca-954f-4ec7-84d6-d37dbacdbadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:49.360865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-59458aca-954f-4ec7-84d6-d37dbacdbadd None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:49.362212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-59458aca-954f-4ec7-84d6-d37dbacdbadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:49.372176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 984/1999] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:49.395515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:49.406995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378fc5-83ca-4f64-abd0-19463654480b service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:49.412670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:49.413401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:49.413743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:49.414082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:49.423657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:49.425295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:49.435499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1016/2000] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:54.407181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d85e8-ccd0-4dcb-8073-efe2a565af44 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:54.407645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d85e8-ccd0-4dcb-8073-efe2a565af44 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:54.407925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d85e8-ccd0-4dcb-8073-efe2a565af44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:54.428090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a68d85e8-ccd0-4dcb-8073-efe2a565af44 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:54.429416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a68d85e8-ccd0-4dcb-8073-efe2a565af44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:54.440326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 985/2001] 10.222.0.25 () {58 vars in 967 bytes} [Sun Oct 23 02:14:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:54.454543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:54.467841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da6b8-76d9-42f5-bd31-2cee4a1d712b service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:54.473119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5539489-3caa-435e-ac2f-a4cdf842e99e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:54.474002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539489-3caa-435e-ac2f-a4cdf842e99e service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:54.474285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539489-3caa-435e-ac2f-a4cdf842e99e service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:54.474561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539489-3caa-435e-ac2f-a4cdf842e99e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:54.484540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5539489-3caa-435e-ac2f-a4cdf842e99e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:54.486172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5539489-3caa-435e-ac2f-a4cdf842e99e service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:54.495040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1017/2002] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:14:58.888072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557d15-12b8-4d26-b089-a8499ccfd5d8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:58.888563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557d15-12b8-4d26-b089-a8499ccfd5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:58.888779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557d15-12b8-4d26-b089-a8499ccfd5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:58.907972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0d557d15-12b8-4d26-b089-a8499ccfd5d8 None None] MFA Rules not processed for user `ab8ab12109f34f0ab1d13b1cf2d375d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:58.909199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0d557d15-12b8-4d26-b089-a8499ccfd5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:58.962347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 986/2003] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:14:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:04.491316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=12 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:08.916551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956e53c-281c-4958-be48-443312239366 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:08.917144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956e53c-281c-4958-be48-443312239366 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:08.917144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956e53c-281c-4958-be48-443312239366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:08.937100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e956e53c-281c-4958-be48-443312239366 None None] MFA Rules not processed for user `933e375f3f54420f961bb34a1e66cc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:08.938287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e956e53c-281c-4958-be48-443312239366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:08.955842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=31 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:08.992183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1018/2004] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:15:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:09.393620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edb5cf-8b5d-4324-b5cc-c82d6b873c60 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:09.394106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edb5cf-8b5d-4324-b5cc-c82d6b873c60 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:09.394527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edb5cf-8b5d-4324-b5cc-c82d6b873c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:09.416033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b3edb5cf-8b5d-4324-b5cc-c82d6b873c60 None None] MFA Rules not processed for user `10e74aaba7cc4b038b5028a76e78feab`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:09.417223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b3edb5cf-8b5d-4324-b5cc-c82d6b873c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:09.483191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 987/2005] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:15:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:18.985332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=25 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:19.473174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=25 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:29.165985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8624a5b-f080-4a57-b9db-9073705bb63a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:29.166481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8624a5b-f080-4a57-b9db-9073705bb63a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:29.166481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8624a5b-f080-4a57-b9db-9073705bb63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:29.186633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e8624a5b-f080-4a57-b9db-9073705bb63a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:29.187818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8624a5b-f080-4a57-b9db-9073705bb63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:29.195582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1019/2006] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:29.223847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edb5cf-8b5d-4324-b5cc-c82d6b873c60 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:15:29.237370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edb5cf-8b5d-4324-b5cc-c82d6b873c60 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:15:29.242890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:15:29.243491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:29.243768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:29.244038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:29.252676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:15:29.254318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:15:29.263603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 988/2007] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:15:32.434717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349d48-17db-47fa-8687-daeab20f6d5e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:32.435712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349d48-17db-47fa-8687-daeab20f6d5e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:32.435882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349d48-17db-47fa-8687-daeab20f6d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:32.455259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4c349d48-17db-47fa-8687-daeab20f6d5e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:32.456434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4c349d48-17db-47fa-8687-daeab20f6d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:32.464090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1020/2008] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:32.486225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:15:32.497324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a995-d729-437e-b3f7-6c812e8ca258 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:15:32.503320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:15:32.503916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:32.504198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:32.504473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:32.512480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:15:32.514647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:15:32.524085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 989/2009] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:15:36.538453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51e3d-7dfe-444a-b006-a2982e5a3b4a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:36.538984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51e3d-7dfe-444a-b006-a2982e5a3b4a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:36.538984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede51e3d-7dfe-444a-b006-a2982e5a3b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:36.558316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ede51e3d-7dfe-444a-b006-a2982e5a3b4a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:36.559479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ede51e3d-7dfe-444a-b006-a2982e5a3b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:36.568746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1021/2010] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:36.606857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:15:36.618375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02672f-d302-4332-a61d-46ed73b1f0d9 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:15:36.624450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:15:36.625023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:36.625296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:36.625571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:36.633633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:15:36.635285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:15:36.645031 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 990/2011] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:15:40.718623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b09bc-03c8-46f7-a11c-bb3aa7cab6d1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:40.719118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b09bc-03c8-46f7-a11c-bb3aa7cab6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:40.719229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b09bc-03c8-46f7-a11c-bb3aa7cab6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:40.740652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-189b09bc-03c8-46f7-a11c-bb3aa7cab6d1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:40.742077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-189b09bc-03c8-46f7-a11c-bb3aa7cab6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:40.749909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1022/2012] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:40.771746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:15:40.783225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb079-3136-485e-897b-8f2cd7d8052d service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:15:40.788618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:15:40.789230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:40.789507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:40.789776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:40.798540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:15:40.800114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:15:40.809701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 991/2013] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:15:45.952489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cec29-e631-48c3-84d0-ebb82e8a9769 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:45.953128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cec29-e631-48c3-84d0-ebb82e8a9769 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:45.953128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cec29-e631-48c3-84d0-ebb82e8a9769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:45.973359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5f8cec29-e631-48c3-84d0-ebb82e8a9769 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:45.974555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f8cec29-e631-48c3-84d0-ebb82e8a9769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:45.982607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1023/2014] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 23 02:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:46.006495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:15:46.018122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a34f-af53-4ebd-99ab-093542707733 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:15:46.023604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5949bc-ac20-4145-8e5c-4d2db60450a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:15:46.024192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5949bc-ac20-4145-8e5c-4d2db60450a7 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:46.024470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5949bc-ac20-4145-8e5c-4d2db60450a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:46.024738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5949bc-ac20-4145-8e5c-4d2db60450a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:46.032823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5949bc-ac20-4145-8e5c-4d2db60450a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:15:46.034431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5949bc-ac20-4145-8e5c-4d2db60450a7 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:15:46.043850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 992/2015] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:15:49.334411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffec6c9-6c85-4c58-8973-bffe33b79379 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:49.334914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffec6c9-6c85-4c58-8973-bffe33b79379 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:49.335009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffec6c9-6c85-4c58-8973-bffe33b79379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:49.354296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9ffec6c9-6c85-4c58-8973-bffe33b79379 None None] MFA Rules not processed for user `be16189fa09d4c70b600601d941e31fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:49.355464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9ffec6c9-6c85-4c58-8973-bffe33b79379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:49.409037 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1024/2016] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:15:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:56.039697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=30 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:59.402209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=40 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:03.398367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:03.399233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:03.399534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:03.419947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] MFA Rules not processed for user `3b1d073ea32449458376dea2ab919a48`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:03.421185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:03.478210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 993/2017] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:13.411364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffec6c9-6c85-4c58-8973-bffe33b79379 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:13.422772 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffec6c9-6c85-4c58-8973-bffe33b79379 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:13.426528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:13.427144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:13.427423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:13.427694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:13.429492 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:13.444595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:13.446200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:13.458443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1025/2018] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:16:13.470363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=25 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:14.764368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:14.766150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:14.778734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb129e-0f3d-4070-bd05-d42331a3ca5b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:14.782860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:14.783951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:14.784289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:14.784624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:14.786643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:14.801016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:14.802718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:14.814469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 994/2019] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:16:19.298808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:19.300295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:19.318391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc8f73-22ec-46bb-9e1b-773ad1ca2b75 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:19.324207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:19.324962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:19.325289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:19.325563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] PATH_INFO: `/v3/users/933e375f3f54420f961bb34a1e66cc14` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:19.326735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=933e375f3f54420f961bb34a1e66cc14)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:19.328732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:19.383039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933e375f3f54420f961bb34a1e66cc14'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.390957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933e375f3f54420f961bb34a1e66cc14'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.391684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933e375f3f54420f961bb34a1e66cc14'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.392326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933e375f3f54420f961bb34a1e66cc14'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.405839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-302a1aed-6719-41ec-a450-735dda0eb19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933e375f3f54420f961bb34a1e66cc14'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.420425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1026/2020] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:19 2022] DELETE /identity/v3/users/933e375f3f54420f961bb34a1e66cc14 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:19.607273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:19.619823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959839-19de-4ab0-bd1f-a7693e845565 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:19.681425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:19.682123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:19.682407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:19.682678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] PATH_INFO: `/v3/projects/6c938a6a5f9e4ed9af35974ed3e1b693` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:19.683824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c938a6a5f9e4ed9af35974ed3e1b693)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:19.685970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:19.749535 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c938a6a5f9e4ed9af35974ed3e1b693', 'request_id': 'req-7d69ae91-986c-4947-8955-76b15ba1e0a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.757895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c938a6a5f9e4ed9af35974ed3e1b693', 'request_id': 'req-7d69ae91-986c-4947-8955-76b15ba1e0a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.768883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c938a6a5f9e4ed9af35974ed3e1b693', 'request_id': 'req-7d69ae91-986c-4947-8955-76b15ba1e0a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.782331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] The token cache is being invalidate because project 6c938a6a5f9e4ed9af35974ed3e1b693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:19.782795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.783452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7d69ae91-986c-4947-8955-76b15ba1e0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:19.788588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 995/2021] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:19 2022] DELETE /identity/v3/projects/6c938a6a5f9e4ed9af35974ed3e1b693 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:19.790508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7600c-aa19-4a3a-a120-4c17c2041e10 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:19.790508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7600c-aa19-4a3a-a120-4c17c2041e10 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:19.791654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7600c-aa19-4a3a-a120-4c17c2041e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:19.813365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f5e7600c-aa19-4a3a-a120-4c17c2041e10 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:19.815604 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f5e7600c-aa19-4a3a-a120-4c17c2041e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:19.887562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1027/2022] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:19.896308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5229cc-3c28-4084-813c-743426958818 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:19.896587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5229cc-3c28-4084-813c-743426958818 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:19.897265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5229cc-3c28-4084-813c-743426958818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:19.919721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3a5229cc-3c28-4084-813c-743426958818 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:19.921307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3a5229cc-3c28-4084-813c-743426958818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:19.931548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 996/2023] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:19.935542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7600c-aa19-4a3a-a120-4c17c2041e10 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:19.950610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7600c-aa19-4a3a-a120-4c17c2041e10 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:19.963753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:19.965404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:19.965404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:19.965593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:19.966897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:19.969244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:19.973184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:20.000897 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1028/2024] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:20.005531 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5229cc-3c28-4084-813c-743426958818 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:20.019910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5229cc-3c28-4084-813c-743426958818 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:20.031924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:20.032639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:20.033257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:20.033656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:20.034525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:20.039371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:20.081022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 997/2025] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:20 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:16:20.085093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:20.096851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454eaea-f3ec-4708-9999-90ea692dc3c6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:20.158095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:20.176596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:20.177249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:20.177531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:20.177803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:20.178448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:20.180376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:20.207154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1029/2026] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:20 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:16:20.208054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:20.220380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911b3b5-5437-4530-a089-15be85df9346 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:20.227092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:20.227923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:20.228203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:20.228473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:20.229152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:20.231082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:20.247332 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 998/2027] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:16:20.251274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:20.262597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119f80-297f-4215-8603-27c91609fe76 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:20.267900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d683d-956e-4720-a72e-c5b3399dc250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:20.269008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d683d-956e-4720-a72e-c5b3399dc250 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:20.269392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d683d-956e-4720-a72e-c5b3399dc250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:20.269817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d683d-956e-4720-a72e-c5b3399dc250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:20.270540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d683d-956e-4720-a72e-c5b3399dc250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:20.273055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d683d-956e-4720-a72e-c5b3399dc250 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:20.290881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1030/2028] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:20.294806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:20.307545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d796c1-eebd-49ac-95a5-c7e6b11c81a9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:20.314523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:20.315197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:20.315527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:20.315923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] PATH_INFO: `/v3/projects/e51bde1b62a04fae93be245b132e6412/users/40f3d602872246a69642449bb792abcf/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:20.333101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51bde1b62a04fae93be245b132e6412, user_id=40f3d602872246a69642449bb792abcf, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:20.336156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:20.350597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 999/2029] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:20 2022] PUT /identity/v3/projects/e51bde1b62a04fae93be245b132e6412/users/40f3d602872246a69642449bb792abcf/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:16:20.355931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff875a-6027-4d0f-b729-87433a0afbfa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:20.356446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff875a-6027-4d0f-b729-87433a0afbfa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:20.356554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff875a-6027-4d0f-b729-87433a0afbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:20.377022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-64ff875a-6027-4d0f-b729-87433a0afbfa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:20.378441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64ff875a-6027-4d0f-b729-87433a0afbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:20.458171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1031/2030] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:20.474319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:20.476428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:20.513302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:20.602087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acf917-51b6-48f3-9e9f-a50f707dfcbe admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:20.609169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:20.611750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:20.612065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:20.612594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:20.638837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:20.641075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:20.657075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1000/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:22.485959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a30b-9e72-4a02-83a6-cfec2d095fe1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:22.486501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a30b-9e72-4a02-83a6-cfec2d095fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:22.486501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a30b-9e72-4a02-83a6-cfec2d095fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:22.506973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-05a0a30b-9e72-4a02-83a6-cfec2d095fe1 None None] MFA Rules not processed for user `ab8ab12109f34f0ab1d13b1cf2d375d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:22.508586 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05a0a30b-9e72-4a02-83a6-cfec2d095fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:22.599608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1032/2032] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:24.970670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:24.973352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:25.126850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b7f58-5693-4d21-b95d-4defa97d01cb service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:25.134566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:25.135210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:25.135494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:25.135769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:25.138651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:25.159229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:25.161917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:25.195035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1001/2033] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:25.636687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a30b-9e72-4a02-83a6-cfec2d095fe1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:25.651612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a30b-9e72-4a02-83a6-cfec2d095fe1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:25.659809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6cc29-7775-4c85-b75a-c875a638a967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:25.660644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cc29-7775-4c85-b75a-c875a638a967 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:25.661444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cc29-7775-4c85-b75a-c875a638a967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:25.662701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cc29-7775-4c85-b75a-c875a638a967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:25.669577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-25c6cc29-7775-4c85-b75a-c875a638a967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:25.783663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6cc29-7775-4c85-b75a-c875a638a967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:25.788038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6cc29-7775-4c85-b75a-c875a638a967 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:25.812665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1033/2034] 10.222.0.25 () {60 vars in 1396 bytes} [Sun Oct 23 02:16:25 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3268 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:27.049624 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:27.059368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54174cdb-47b9-4524-a3d4-bd2b54eaf61d service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:27.063455 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:27.064734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:27.065421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:27.065994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:27.068100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:27.084571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:27.086706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:27.103336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1002/2035] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:29.976840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a514-5565-4175-9c2e-bb2193614522 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:29.978232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a514-5565-4175-9c2e-bb2193614522 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:29.978988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a514-5565-4175-9c2e-bb2193614522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:30.017335 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:30.029406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6107a514-5565-4175-9c2e-bb2193614522 None None] MFA Rules not processed for user `40f3d602872246a69642449bb792abcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:30.031388 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6107a514-5565-4175-9c2e-bb2193614522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:30.170373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1034/2036] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:30.171665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:30.197878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42358df-68f5-436a-9239-ee8a1686fc15 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:30.213082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:30.213830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:30.214207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:30.214584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:30.215329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:30.217420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:30.296359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1003/2037] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:30 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:30.300232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107a514-5565-4175-9c2e-bb2193614522 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:30.316707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107a514-5565-4175-9c2e-bb2193614522 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:30.457687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:30.458598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:30.459184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:30.459615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:30.460537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:30.462756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:30.522917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1035/2038] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:30 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:30.526817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:30.544717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0322e-7bb8-40ac-b4ce-aa189e8c0148 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:30.551662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:30.552538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:30.553037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:30.553515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:30.554367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:30.556163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:30.573732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1004/2039] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:30.577585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:30.600354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecdd00-418f-4b53-8af3-0b3e3c1b5c07 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:30.616472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:30.616738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:30.617299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:30.617975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] PATH_INFO: `/v3/projects/a924e9c86a934dc2824d9ff92dacee62/users/57629c4e2ff245529affa92e43d22c21/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:30.656049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a924e9c86a934dc2824d9ff92dacee62, user_id=57629c4e2ff245529affa92e43d22c21, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:30.658922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:30.692550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1036/2040] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:30 2022] PUT /identity/v3/projects/a924e9c86a934dc2824d9ff92dacee62/users/57629c4e2ff245529affa92e43d22c21/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:30.697037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:30.711840 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cbc3d-4042-492a-99e9-82a57a72eb2e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:30.783346 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:30.792307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:30.794344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:30.795685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:30.797005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:30.799733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:30.801284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:30.816197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1005/2041] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:30.817716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:30.835815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551011-ec3b-4267-9380-2a20e4107864 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:30.843310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:30.844043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:30.845329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:30.845329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] PATH_INFO: `/v3/projects/a924e9c86a934dc2824d9ff92dacee62/users/57629c4e2ff245529affa92e43d22c21/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:30.848695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a924e9c86a934dc2824d9ff92dacee62, user_id=57629c4e2ff245529affa92e43d22c21, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:30.852286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:30.865363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1037/2042] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:30 2022] PUT /identity/v3/projects/a924e9c86a934dc2824d9ff92dacee62/users/57629c4e2ff245529affa92e43d22c21/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:33.889932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:33.893631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:33.922131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376782e-1af0-43dd-a2a2-e2cdd5f977b7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:34.035383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:34.036065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:34.036349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:34.036618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] PATH_INFO: `/v3/users/10e74aaba7cc4b038b5028a76e78feab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:34.038002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e74aaba7cc4b038b5028a76e78feab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:34.041224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:34.105215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e74aaba7cc4b038b5028a76e78feab'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.110113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e74aaba7cc4b038b5028a76e78feab'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.127460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e74aaba7cc4b038b5028a76e78feab'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.128142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e74aaba7cc4b038b5028a76e78feab'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.144747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9cad74a4-d73e-4121-a4d8-52c098e960dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e74aaba7cc4b038b5028a76e78feab'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.169101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1006/2043] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:33 2022] DELETE /identity/v3/users/10e74aaba7cc4b038b5028a76e78feab => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:34.482874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:34.484667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:34.530909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d82f5-d442-418e-9662-16d836f0688a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:34.685297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:34.700203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:34.701880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:34.702253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:34.702684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] PATH_INFO: `/v3/projects/e1f481fd4ef64aa19b3edfddaa21e6c9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:34.704987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f481fd4ef64aa19b3edfddaa21e6c9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:34.707679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:34.798719 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f481fd4ef64aa19b3edfddaa21e6c9', 'request_id': 'req-621363ac-502c-4b4e-acbe-5cad8993b933'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.818419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f481fd4ef64aa19b3edfddaa21e6c9', 'request_id': 'req-621363ac-502c-4b4e-acbe-5cad8993b933'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.827779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f481fd4ef64aa19b3edfddaa21e6c9', 'request_id': 'req-621363ac-502c-4b4e-acbe-5cad8993b933'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.843864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] The token cache is being invalidate because project e1f481fd4ef64aa19b3edfddaa21e6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:34.845053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.846086 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-621363ac-502c-4b4e-acbe-5cad8993b933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:34.849416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1038/2044] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:34 2022] DELETE /identity/v3/projects/e1f481fd4ef64aa19b3edfddaa21e6c9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:34.854083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96b197-c3a1-4458-abb6-12cddf43e890 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:34.854376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96b197-c3a1-4458-abb6-12cddf43e890 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:34.861248 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96b197-c3a1-4458-abb6-12cddf43e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:34.908690 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7f96b197-c3a1-4458-abb6-12cddf43e890 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:34.909962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7f96b197-c3a1-4458-abb6-12cddf43e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:35.030769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1007/2045] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:35.039135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e0c0-fb39-42a8-b6ec-ee6a5cf95366 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.039320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e0c0-fb39-42a8-b6ec-ee6a5cf95366 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.039558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e0c0-fb39-42a8-b6ec-ee6a5cf95366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.070555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cc56e0c0-fb39-42a8-b6ec-ee6a5cf95366 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:35.077662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cc56e0c0-fb39-42a8-b6ec-ee6a5cf95366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:35.094016 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1039/2046] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:35.098744 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96b197-c3a1-4458-abb6-12cddf43e890 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:35.134001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96b197-c3a1-4458-abb6-12cddf43e890 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:35.145887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:35.146551 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.146830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.147107 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.147772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:35.148072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:35.149723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:35.163813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:35.177259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1008/2047] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:35.178035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e0c0-fb39-42a8-b6ec-ee6a5cf95366 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:35.188668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e0c0-fb39-42a8-b6ec-ee6a5cf95366 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:35.200878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:35.201982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.203500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.206208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.208351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:35.210609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:35.276166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1040/2048] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:35 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:16:35.280635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:35.294304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5d18-bdac-409b-b1ae-151f92a7a84e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:35.409898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:35.410208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.410485 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.410762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.411409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:35.413580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:35.445260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1009/2049] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:35 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:35.449390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:35.471145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2424e-e0c3-442b-86f7-daa97c9f6d0b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:35.483566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:35.484239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.484473 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.484740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.485464 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:35.487129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:35.505126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1041/2050] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:35.509310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:35.527536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b68f-6f89-4abc-a0f6-ad64b8f838c2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:35.537413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee38597-83a7-42f7-9d6a-34a599e97322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:35.538046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38597-83a7-42f7-9d6a-34a599e97322 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.538322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38597-83a7-42f7-9d6a-34a599e97322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.538849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38597-83a7-42f7-9d6a-34a599e97322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.539315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee38597-83a7-42f7-9d6a-34a599e97322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:35.540833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee38597-83a7-42f7-9d6a-34a599e97322 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:35.578497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1010/2051] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:35.580341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:35.617119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816450b4-e023-4103-9ed8-adc2ed98808b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:35.637766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:35.639986 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.640285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.642682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] PATH_INFO: `/v3/projects/c02eb96cc4f441689d66f0ba17f3ea68/users/2ca506b6e476407e8eea4028c5960569/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.681220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02eb96cc4f441689d66f0ba17f3ea68, user_id=2ca506b6e476407e8eea4028c5960569, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:35.687342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:35.726769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1042/2052] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:35 2022] PUT /identity/v3/projects/c02eb96cc4f441689d66f0ba17f3ea68/users/2ca506b6e476407e8eea4028c5960569/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:16:35.736728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496a95-11a0-44fd-9c96-d12476d1cac1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:35.737032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496a95-11a0-44fd-9c96-d12476d1cac1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:35.737314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496a95-11a0-44fd-9c96-d12476d1cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:35.790701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4e496a95-11a0-44fd-9c96-d12476d1cac1 None None] MFA Rules not processed for user `2ca506b6e476407e8eea4028c5960569`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:35.792365 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4e496a95-11a0-44fd-9c96-d12476d1cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:35.934342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1011/2053] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:35.940294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:36.061698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af270eb-c2b1-4e5e-8f32-623968f9f643 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:36.070044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99378663-4057-4947-9723-f116095b8350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:36.070912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99378663-4057-4947-9723-f116095b8350 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.071408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99378663-4057-4947-9723-f116095b8350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.071853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99378663-4057-4947-9723-f116095b8350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.072660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99378663-4057-4947-9723-f116095b8350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:36.075221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99378663-4057-4947-9723-f116095b8350 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:36.152245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1043/2054] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:35 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:36.155842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e496a95-11a0-44fd-9c96-d12476d1cac1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:36.167084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e496a95-11a0-44fd-9c96-d12476d1cac1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:36.246464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:36.247353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.247638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.247960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.248686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:36.251939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:36.267259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:36.290816 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1012/2055] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:36 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:16:36.294641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99378663-4057-4947-9723-f116095b8350 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:36.305305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:36.327048 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99378663-4057-4947-9723-f116095b8350 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:36.338470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:36.339307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.339743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.340321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.341358 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:36.343414 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:36.357404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1044/2056] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:36.361723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:36.378531 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a71995-3e86-4a70-9546-709d88a538c7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:36.384527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:36.385384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.385815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.386012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] PATH_INFO: `/v3/projects/c91869621a3f4500b909dc9c559f3b9b/users/57f8874e336d4c649a24b2fd1db932a7/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.408166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91869621a3f4500b909dc9c559f3b9b, user_id=57f8874e336d4c649a24b2fd1db932a7, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:36.411544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:36.447755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:36.448677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1013/2057] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:36 2022] PUT /identity/v3/projects/c91869621a3f4500b909dc9c559f3b9b/users/57f8874e336d4c649a24b2fd1db932a7/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:36.460084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97265785-fa4c-4919-bddd-a38c1b5673af admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:36.532928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f8222-9d90-4153-9378-ddd5c0c39ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:36.533686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f8222-9d90-4153-9378-ddd5c0c39ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.534377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f8222-9d90-4153-9378-ddd5c0c39ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.534377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f8222-9d90-4153-9378-ddd5c0c39ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.535138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f8222-9d90-4153-9378-ddd5c0c39ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:36.536900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f8222-9d90-4153-9378-ddd5c0c39ae9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:36.555500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1045/2058] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:36.556590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:36.568168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db11e34-8657-4a05-b70e-3da0113d6b3e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:36.573195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:36.573989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.574403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.574789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] PATH_INFO: `/v3/projects/c91869621a3f4500b909dc9c559f3b9b/users/57f8874e336d4c649a24b2fd1db932a7/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.576827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91869621a3f4500b909dc9c559f3b9b, user_id=57f8874e336d4c649a24b2fd1db932a7, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:36.579660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:36.591286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1014/2059] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:36 2022] PUT /identity/v3/projects/c91869621a3f4500b909dc9c559f3b9b/users/57f8874e336d4c649a24b2fd1db932a7/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:16:36.605081 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cb64-7bc1-4646-b3f0-0d2736a69fea None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.605456 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cb64-7bc1-4646-b3f0-0d2736a69fea None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.606566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cb64-7bc1-4646-b3f0-0d2736a69fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.647404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c763cb64-7bc1-4646-b3f0-0d2736a69fea None None] MFA Rules not processed for user `57f8874e336d4c649a24b2fd1db932a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:36.649534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c763cb64-7bc1-4646-b3f0-0d2736a69fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:36.773760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1046/2060] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:36.787815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:36.790228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:36.926700 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affb6a7-6416-4f58-ae97-ef90a430cc59 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:36.933304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66b077-1fce-4376-98b2-fd3ad9b34e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:36.934172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66b077-1fce-4376-98b2-fd3ad9b34e17 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:36.934666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66b077-1fce-4376-98b2-fd3ad9b34e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:36.935273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66b077-1fce-4376-98b2-fd3ad9b34e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:36.960995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66b077-1fce-4376-98b2-fd3ad9b34e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:36.963016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66b077-1fce-4376-98b2-fd3ad9b34e17 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:36.984719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1015/2061] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:16:37.163730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cb64-7bc1-4646-b3f0-0d2736a69fea None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:37.181138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cb64-7bc1-4646-b3f0-0d2736a69fea None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:37.185756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:37.186374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:37.186649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:37.186915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:37.302629 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093532-eb1e-475e-9b31-893d6124079e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:37.304004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093532-eb1e-475e-9b31-893d6124079e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:37.304284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093532-eb1e-475e-9b31-893d6124079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:37.308326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:37.332522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:37.341938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-95093532-eb1e-475e-9b31-893d6124079e None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:37.343177 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-95093532-eb1e-475e-9b31-893d6124079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:37.348311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1047/2062] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:37.443633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1016/2063] 10.222.0.25 () {58 vars in 967 bytes} [Sun Oct 23 02:16:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:37.536006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:37.537568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:37.578527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:37.698428 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9410cb2-db50-4fd4-b997-261295e696ea service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:37.705317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:37.706997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:37.707352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:37.707686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:37.722942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:37.725796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:37.736827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1048/2064] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:16:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:16:37.967411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c8ae-7937-411d-a2a0-bb74b6a53f97 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:37.967893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c8ae-7937-411d-a2a0-bb74b6a53f97 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:37.968170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c8ae-7937-411d-a2a0-bb74b6a53f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:38.013730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8195c8ae-7937-411d-a2a0-bb74b6a53f97 None None] MFA Rules not processed for user `57629c4e2ff245529affa92e43d22c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:38.014833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8195c8ae-7937-411d-a2a0-bb74b6a53f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:38.086442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:38.135318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1017/2065] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:38.149600 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:38.151199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:38.266266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af357a-dfa6-4cfd-8982-ff0969190b23 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:38.273397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:38.273853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:38.274209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:38.274546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:38.276401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:38.370085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:38.371784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:38.383028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1049/2066] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:39.747262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7394-c1fe-4abb-b3fc-bdac8fde1ca7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:39.747746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7394-c1fe-4abb-b3fc-bdac8fde1ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:39.747833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7394-c1fe-4abb-b3fc-bdac8fde1ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:39.789185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5c0e7394-c1fe-4abb-b3fc-bdac8fde1ca7 None None] MFA Rules not processed for user `40f3d602872246a69642449bb792abcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:39.790710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c0e7394-c1fe-4abb-b3fc-bdac8fde1ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:39.810707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1018/2067] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:40.334859 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:40.337869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:40.451066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:40.497845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bc3e-5b82-4cc3-b939-5bbd04dd0014 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:40.519574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d7ec-42bc-4fa8-ac71-45439f8f53ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:40.527596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d7ec-42bc-4fa8-ac71-45439f8f53ee service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:40.527829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d7ec-42bc-4fa8-ac71-45439f8f53ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:40.528112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d7ec-42bc-4fa8-ac71-45439f8f53ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:40.533482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2661d7ec-42bc-4fa8-ac71-45439f8f53ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:40.557747 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661d7ec-42bc-4fa8-ac71-45439f8f53ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:40.559268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661d7ec-42bc-4fa8-ac71-45439f8f53ee service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:40.592338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1050/2068] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:44.611652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e7394-c1fe-4abb-b3fc-bdac8fde1ca7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:44.688703 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e7394-c1fe-4abb-b3fc-bdac8fde1ca7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:44.694547 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:44.695489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:44.695998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:44.696489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] PATH_INFO: `/v3/users/2ca506b6e476407e8eea4028c5960569` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:44.697970 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca506b6e476407e8eea4028c5960569)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:44.700300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:44.762257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca506b6e476407e8eea4028c5960569'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:44.762836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca506b6e476407e8eea4028c5960569'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:44.774887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca506b6e476407e8eea4028c5960569'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:44.775596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca506b6e476407e8eea4028c5960569'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:44.801404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca506b6e476407e8eea4028c5960569'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:44.824048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1019/2069] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:44 2022] DELETE /identity/v3/users/2ca506b6e476407e8eea4028c5960569 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:16:44.828654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:44.829216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:44.829216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:44.871344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:44.873449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:44.978244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1051/2070] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:44.988526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:44.990883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:45.109422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef311d-7963-49a8-bf35-cfe5ef99d187 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:45.119561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:45.120355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:45.120643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:45.120917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:45.133955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:45.136046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:45.146725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1020/2071] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:45.387200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:45.388726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:45.503488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133c69-acd8-42cc-9eed-0b98153adc7b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:45.512274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:45.513263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:45.513739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:45.514232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:45.516386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:45.534645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:45.536864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:45.569556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1052/2072] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:45.618747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:45.620482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:45.642645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a39a08-19ff-45a3-9e1a-9010cd95cd1e service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:45.652530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:45.655425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:45.655883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:45.656356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] PATH_INFO: `/v3/projects/c02eb96cc4f441689d66f0ba17f3ea68` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:45.659665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02eb96cc4f441689d66f0ba17f3ea68)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:45.662064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:45.664710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:45.808153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02eb96cc4f441689d66f0ba17f3ea68', 'request_id': 'req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:45.815321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02eb96cc4f441689d66f0ba17f3ea68', 'request_id': 'req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:45.833460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02eb96cc4f441689d66f0ba17f3ea68', 'request_id': 'req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:45.851550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] The token cache is being invalidate because project c02eb96cc4f441689d66f0ba17f3ea68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:45.852755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:45.855289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:45.858658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1021/2073] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:45 2022] DELETE /identity/v3/projects/c02eb96cc4f441689d66f0ba17f3ea68 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:45.863390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:45.877542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56dc37-bc44-4ce3-93a6-bd9d314a0695 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:45.977067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:45.978394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:45.979985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:45.980797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] PATH_INFO: `/v3/users/57f8874e336d4c649a24b2fd1db932a7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:45.983592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f8874e336d4c649a24b2fd1db932a7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:45.987995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:46.001866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:46.072080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f8874e336d4c649a24b2fd1db932a7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:46.080487 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f8874e336d4c649a24b2fd1db932a7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:46.081539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f8874e336d4c649a24b2fd1db932a7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:46.082316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f8874e336d4c649a24b2fd1db932a7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:46.103837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be72f396-317c-470c-b6b9-8246ddf7f4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f8874e336d4c649a24b2fd1db932a7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:46.143271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1053/2074] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:45 2022] DELETE /identity/v3/users/57f8874e336d4c649a24b2fd1db932a7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:46.824047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:46.827959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:46.843437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cffa2-21bf-4e92-b67b-0af0ae1c639f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:46.948272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:46.948916 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:46.949294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:46.949594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] PATH_INFO: `/v3/projects/c91869621a3f4500b909dc9c559f3b9b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:46.950722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91869621a3f4500b909dc9c559f3b9b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:46.952631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.018550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91869621a3f4500b909dc9c559f3b9b', 'request_id': 'req-b827d5bd-7270-4a1a-9faa-b284f8011440'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.028122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91869621a3f4500b909dc9c559f3b9b', 'request_id': 'req-b827d5bd-7270-4a1a-9faa-b284f8011440'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.039423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91869621a3f4500b909dc9c559f3b9b', 'request_id': 'req-b827d5bd-7270-4a1a-9faa-b284f8011440'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.052637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] The token cache is being invalidate because project c91869621a3f4500b909dc9c559f3b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:47.052830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.053612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b827d5bd-7270-4a1a-9faa-b284f8011440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.055377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1022/2075] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:46 2022] DELETE /identity/v3/projects/c91869621a3f4500b909dc9c559f3b9b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:47.061062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55380d-2632-4ab2-9724-d0200f150a61 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.061622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55380d-2632-4ab2-9724-d0200f150a61 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.061622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55380d-2632-4ab2-9724-d0200f150a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.100560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9b55380d-2632-4ab2-9724-d0200f150a61 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:47.102635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9b55380d-2632-4ab2-9724-d0200f150a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:47.222080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1054/2076] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:47.229891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878cc6-9f4c-4347-9811-6d2656631090 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.230179 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878cc6-9f4c-4347-9811-6d2656631090 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.230481 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878cc6-9f4c-4347-9811-6d2656631090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.260847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d2878cc6-9f4c-4347-9811-6d2656631090 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:47.262157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d2878cc6-9f4c-4347-9811-6d2656631090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:47.277625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1023/2077] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:47.278867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55380d-2632-4ab2-9724-d0200f150a61 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.292447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55380d-2632-4ab2-9724-d0200f150a61 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.306209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.307197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.307626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.308043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.308920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:47.309386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.311332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.325384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1055/2078] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:47.329921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878cc6-9f4c-4347-9811-6d2656631090 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.341761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878cc6-9f4c-4347-9811-6d2656631090 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.347647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.348672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.349113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.349477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.350537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.352532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.367594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:47.426581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1024/2079] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:47 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:47.431362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.449307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93f465-b12c-4c03-855e-d1d50e2f3f20 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.521818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.522427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.522732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.522986 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.523620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.525592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.560411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1056/2080] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:47 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:47.565001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.576299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8306-8042-45fe-9487-7a1e908d58c1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.581634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.582237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.582517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.582785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.583431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.585219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.589694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.591740 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:47.595870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1025/2081] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:47.597191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:47.599792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.612867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328dd8b-65f9-472d-8c55-2b00e01a3925 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.618893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.619705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.619985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.620253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.620883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.622568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.636949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1026/2082] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:16:47.640087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.653979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73964a37-bcfa-49d3-aea1-4f20c8bbace5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.659727 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.660283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.660561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.660837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] PATH_INFO: `/v3/projects/00b9c163233948098d0be34646bc039b/users/3c3f0fe1abe049e799df11214ee7da22/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.680045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b9c163233948098d0be34646bc039b, user_id=3c3f0fe1abe049e799df11214ee7da22, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.681732 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcee79-ffd5-4aa5-b83e-bc39504eeee9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.682905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.687474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a44aa9-853f-44ba-b59b-017176ba0079 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.688762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a44aa9-853f-44ba-b59b-017176ba0079 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.689387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a44aa9-853f-44ba-b59b-017176ba0079 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.689683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a44aa9-853f-44ba-b59b-017176ba0079 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.692053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-39a44aa9-853f-44ba-b59b-017176ba0079 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:47.701163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1027/2083] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:47 2022] PUT /identity/v3/projects/00b9c163233948098d0be34646bc039b/users/3c3f0fe1abe049e799df11214ee7da22/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:47.705213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.705213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:47.705405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a44aa9-853f-44ba-b59b-017176ba0079 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.708145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a44aa9-853f-44ba-b59b-017176ba0079 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.719012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1057/2084] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:16:47.720315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ff19-0a54-441e-b9fd-dae258488e52 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.720601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ff19-0a54-441e-b9fd-dae258488e52 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.720936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ff19-0a54-441e-b9fd-dae258488e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.755588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c0a4ff19-0a54-441e-b9fd-dae258488e52 None None] MFA Rules not processed for user `3c3f0fe1abe049e799df11214ee7da22`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:47.757672 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0a4ff19-0a54-441e-b9fd-dae258488e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:47.783835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc37485-cc88-45e2-9d7e-d3ee1271c1df admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.790435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.791556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.792130 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.792412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] PATH_INFO: `/v3/users/9d2ec2dff418461fb79f8dcd4c436f7c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.793594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2ec2dff418461fb79f8dcd4c436f7c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.795512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.831256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1058/2085] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:47.835921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4ff19-0a54-441e-b9fd-dae258488e52 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.847367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4ff19-0a54-441e-b9fd-dae258488e52 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.852624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.853074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2ec2dff418461fb79f8dcd4c436f7c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.853554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.853554 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.853777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.854474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.854593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2ec2dff418461fb79f8dcd4c436f7c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.856433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.865328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2ec2dff418461fb79f8dcd4c436f7c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.866569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2ec2dff418461fb79f8dcd4c436f7c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.896931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2ec2dff418461fb79f8dcd4c436f7c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:47.910525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1059/2086] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:47 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:16:47.911380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1028/2087] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:47 2022] DELETE /identity/v3/users/9d2ec2dff418461fb79f8dcd4c436f7c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:47.911795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.913505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:47.979379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f6b4-5b54-46ac-8964-503ac3e9e9f3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.983630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:48.042370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.043002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.043277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.043547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.044181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.046247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.073763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1060/2088] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:47 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:48.075795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.086718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c7226-534d-447a-b8fc-209a63c8822d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.091295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.091911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.092168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.092446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.093141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.095280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.111656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1029/2089] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:48.116076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.131253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e43e-82ad-4106-b77b-22ed4d20005b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.136126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.136797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.137110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.137384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] PATH_INFO: `/v3/projects/fc99033473724bacb222962792bc89f8/users/636563e19f1a4a568121d2e04c0152bc/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.157744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc99033473724bacb222962792bc89f8, user_id=636563e19f1a4a568121d2e04c0152bc, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.160551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.181551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1061/2090] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:48 2022] PUT /identity/v3/projects/fc99033473724bacb222962792bc89f8/users/636563e19f1a4a568121d2e04c0152bc/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:48.182586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.195849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89991acb-614a-409f-8157-6295148a2b57 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.206075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:48.257971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434ab3e-d067-4732-ac4b-8418a42f418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.258678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ab3e-d067-4732-ac4b-8418a42f418b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.259023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ab3e-d067-4732-ac4b-8418a42f418b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.259362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ab3e-d067-4732-ac4b-8418a42f418b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.260067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434ab3e-d067-4732-ac4b-8418a42f418b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.261755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434ab3e-d067-4732-ac4b-8418a42f418b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.275996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1030/2091] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:48.277289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.290530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bb2b-cc19-41b6-ab76-e17c0b1e3e10 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.295882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.296667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.297042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.297404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] PATH_INFO: `/v3/projects/fc99033473724bacb222962792bc89f8/users/636563e19f1a4a568121d2e04c0152bc/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.299385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc99033473724bacb222962792bc89f8, user_id=636563e19f1a4a568121d2e04c0152bc, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.302644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.313698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1062/2092] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:48 2022] PUT /identity/v3/projects/fc99033473724bacb222962792bc89f8/users/636563e19f1a4a568121d2e04c0152bc/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:16:48.323906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.324192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.324468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.353089 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] MFA Rules not processed for user `636563e19f1a4a568121d2e04c0152bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:48.354315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.360217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.362327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.431113 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1031/2093] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:48.436010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd158309-9639-47c1-b142-de1d53a8a8ec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.441517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.442136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.442695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.443144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] PATH_INFO: `/v3/projects/a1aa24f99b90478e9b9b315576daf9bb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.443389 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.444502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1aa24f99b90478e9b9b315576daf9bb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.444726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.446502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.497114 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1aa24f99b90478e9b9b315576daf9bb', 'request_id': 'req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.503760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dcbc9-889d-4b55-b9bb-5daf3ffde275 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.505615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1aa24f99b90478e9b9b315576daf9bb', 'request_id': 'req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.510453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:48.512929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1aa24f99b90478e9b9b315576daf9bb', 'request_id': 'req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.530260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] The token cache is being invalidate because project a1aa24f99b90478e9b9b315576daf9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:48.530549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.531269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.533116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1063/2094] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:48 2022] DELETE /identity/v3/projects/a1aa24f99b90478e9b9b315576daf9bb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:48.538342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.539817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.561379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.562003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.562281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.562556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.564891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.570043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:48.607405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6840ff-82c9-44f0-aa4e-ab260626bfa0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.612532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.613184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.613462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.613734 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] PATH_INFO: `/v3/users/1b529ac1136e46d7a3647f378c4e5638` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.614849 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b529ac1136e46d7a3647f378c4e5638)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.616792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.630723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.632229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.642089 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1032/2095] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:48.666415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b529ac1136e46d7a3647f378c4e5638'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.674441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b529ac1136e46d7a3647f378c4e5638'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.675151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b529ac1136e46d7a3647f378c4e5638'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.675786 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b529ac1136e46d7a3647f378c4e5638'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.686886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.688948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.689231 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b529ac1136e46d7a3647f378c4e5638'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:48.699668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d11f-78c4-4b89-befb-8a2975350679 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.702514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1064/2096] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:48 2022] DELETE /identity/v3/users/1b529ac1136e46d7a3647f378c4e5638 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:16:48.703368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.703962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.704239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.704508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.706426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.772408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.772408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.797079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1033/2097] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:16:48.890019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:48.891592 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:48.967610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40072a-4358-4170-88d7-0ba028c1a669 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:48.972821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:48.973790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:48.974077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:48.974470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] PATH_INFO: `/v3/projects/563c1a4066414796b0f1409afcfb527f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:48.976073 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] RBAC: Authorizing `identity:delete_project(project_id=563c1a4066414796b0f1409afcfb527f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:48.978455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:48.992102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:49.038491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563c1a4066414796b0f1409afcfb527f', 'request_id': 'req-4a461bd3-fdf9-432b-ab63-ef8303ae223b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:49.048069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563c1a4066414796b0f1409afcfb527f', 'request_id': 'req-4a461bd3-fdf9-432b-ab63-ef8303ae223b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:49.055854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563c1a4066414796b0f1409afcfb527f', 'request_id': 'req-4a461bd3-fdf9-432b-ab63-ef8303ae223b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:49.069686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] The token cache is being invalidate because project 563c1a4066414796b0f1409afcfb527f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:49.070006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:49.070690 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4a461bd3-fdf9-432b-ab63-ef8303ae223b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:49.073023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1065/2098] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:48 2022] DELETE /identity/v3/projects/563c1a4066414796b0f1409afcfb527f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:52.152486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:52.153889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:52.167929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288c666-adfe-422d-87f1-dd8c303244ee service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:52.227096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:52.227862 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:52.228155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:52.228424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] PATH_INFO: `/v3/users/3c3f0fe1abe049e799df11214ee7da22` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:52.229573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3f0fe1abe049e799df11214ee7da22)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:52.231476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:52.273571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:52.279913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3f0fe1abe049e799df11214ee7da22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.280557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3f0fe1abe049e799df11214ee7da22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.288284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3f0fe1abe049e799df11214ee7da22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.288883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3f0fe1abe049e799df11214ee7da22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.300893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3f0fe1abe049e799df11214ee7da22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.313141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1034/2099] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:52 2022] DELETE /identity/v3/users/3c3f0fe1abe049e799df11214ee7da22 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:52.317824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:52.318318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:52.318412 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:52.337280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:52.338470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:52.398170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1066/2100] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:52.408470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:52.409973 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:52.470828 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82f10-1213-448b-bbf2-945ac69fc775 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:52.474468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:52.475062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:52.475619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:52.475888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:52.485069 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:52.486493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:52.496162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1035/2101] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:52.762835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:52.764298 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:52.776952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64954247-6530-4ab7-99aa-a220a14fd10a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:52.782225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:52.782863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:52.783163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:52.783442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] PATH_INFO: `/v3/projects/00b9c163233948098d0be34646bc039b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:52.784570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b9c163233948098d0be34646bc039b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:52.786539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:52.833976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b9c163233948098d0be34646bc039b', 'request_id': 'req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.840893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b9c163233948098d0be34646bc039b', 'request_id': 'req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.846390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b9c163233948098d0be34646bc039b', 'request_id': 'req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.858694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] The token cache is being invalidate because project 00b9c163233948098d0be34646bc039b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:52.858983 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.859644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.861135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1067/2102] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:52 2022] DELETE /identity/v3/projects/00b9c163233948098d0be34646bc039b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:52.865131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:52.874527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb22a99-71ba-4782-95b7-1b09056bc37b service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:52.929735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:52.930281 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:52.930558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:52.930826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] PATH_INFO: `/v3/users/636563e19f1a4a568121d2e04c0152bc` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:52.931915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=636563e19f1a4a568121d2e04c0152bc)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:52.933837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:52.979271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636563e19f1a4a568121d2e04c0152bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.979940 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636563e19f1a4a568121d2e04c0152bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.987813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636563e19f1a4a568121d2e04c0152bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.988486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636563e19f1a4a568121d2e04c0152bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:52.995655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:53.003146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e2859479-7215-4755-ae61-bb7951e50b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636563e19f1a4a568121d2e04c0152bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:53.016119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1036/2103] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:52 2022] DELETE /identity/v3/users/636563e19f1a4a568121d2e04c0152bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:53.278211 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.279882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:53.293034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b3a00-d9ee-4595-80b9-b9f4a64f8299 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.313768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:53.354622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.355282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.355548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.355814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] PATH_INFO: `/v3/projects/fc99033473724bacb222962792bc89f8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.356936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc99033473724bacb222962792bc89f8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.358860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.404932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc99033473724bacb222962792bc89f8', 'request_id': 'req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:53.412486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc99033473724bacb222962792bc89f8', 'request_id': 'req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:53.417952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc99033473724bacb222962792bc89f8', 'request_id': 'req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:53.429370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] The token cache is being invalidate because project fc99033473724bacb222962792bc89f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:53.429652 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:53.430268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd5cea6a-d49b-4859-93af-17b3e4fd04c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:53.431727 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1068/2104] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:53 2022] DELETE /identity/v3/projects/fc99033473724bacb222962792bc89f8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:16:53.436566 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa187-a53b-4933-a58c-f565bb0be027 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.437142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa187-a53b-4933-a58c-f565bb0be027 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.437274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa187-a53b-4933-a58c-f565bb0be027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.456704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f03aa187-a53b-4933-a58c-f565bb0be027 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:53.457934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f03aa187-a53b-4933-a58c-f565bb0be027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:53.524739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1037/2105] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:53.532966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d85ed-d1c7-49be-b1bf-1546483e0b93 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.533273 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d85ed-d1c7-49be-b1bf-1546483e0b93 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.533545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d85ed-d1c7-49be-b1bf-1546483e0b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.553317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d70d85ed-d1c7-49be-b1bf-1546483e0b93 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:53.554493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d70d85ed-d1c7-49be-b1bf-1546483e0b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:53.562133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1069/2106] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:53.566206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aa187-a53b-4933-a58c-f565bb0be027 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.575829 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aa187-a53b-4933-a58c-f565bb0be027 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.580337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.580929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.581239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.581508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.582176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:53.582479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.584057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.595972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1038/2107] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:53.600501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d85ed-d1c7-49be-b1bf-1546483e0b93 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.610186 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d85ed-d1c7-49be-b1bf-1546483e0b93 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.614738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.615321 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.615596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.615864 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.616479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.618399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.644657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1070/2108] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:53 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:53.648691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.658918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591a70-a6c2-4f81-a15d-75f3ae66c18a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.713129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.713669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.713958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.714325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.715149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.717092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.739479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1039/2109] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:53 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:53.743634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.754169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9fe9-9b12-460b-a92c-b97959ef3a01 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.758851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.759448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.759727 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.759999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.760636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.762260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.772527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1071/2110] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:53.776486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.787082 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c7ea-a412-4c98-bfa7-3be258f9f62d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.791674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b4818-1a5d-445e-8cac-abf49cd11d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.792260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4818-1a5d-445e-8cac-abf49cd11d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.792540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4818-1a5d-445e-8cac-abf49cd11d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.792809 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4818-1a5d-445e-8cac-abf49cd11d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.793466 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b4818-1a5d-445e-8cac-abf49cd11d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.795042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b4818-1a5d-445e-8cac-abf49cd11d02 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.805358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1040/2111] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:53.809394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.819095 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae100b01-e3f2-4fd6-ad5f-d6d2f708057b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.823837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.824475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.824754 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.825067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] PATH_INFO: `/v3/projects/1be81714419f47919249abdbd90acaa7/users/0c2dbf807cfb4854a794e9008e4f524e/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.839767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be81714419f47919249abdbd90acaa7, user_id=0c2dbf807cfb4854a794e9008e4f524e, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.842445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.857102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1072/2112] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:53 2022] PUT /identity/v3/projects/1be81714419f47919249abdbd90acaa7/users/0c2dbf807cfb4854a794e9008e4f524e/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:53.868676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebc09-e929-4997-b19a-bfbb13e19e93 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.868957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebc09-e929-4997-b19a-bfbb13e19e93 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.869278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebc09-e929-4997-b19a-bfbb13e19e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.896560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-05aebc09-e929-4997-b19a-bfbb13e19e93 None None] MFA Rules not processed for user `0c2dbf807cfb4854a794e9008e4f524e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:53.897791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-05aebc09-e929-4997-b19a-bfbb13e19e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:53.930770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:53.962475 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1041/2113] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:53.967049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.014615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:54.030475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b2188-4861-4331-be07-ec34fe0131c7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.035149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.035746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.036049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.036320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.036938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.038848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.065635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1073/2114] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:53 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:54.069759 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aebc09-e929-4997-b19a-bfbb13e19e93 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.080831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aebc09-e929-4997-b19a-bfbb13e19e93 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.136641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.137301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.137578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.137852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.138482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.140390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.162153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1042/2115] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:54 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:16:54.166133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.176294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdd289-8073-4861-9e0f-dc8a5fa10890 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.180879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.181495 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.181773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.182043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.182684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.184251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.194996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1074/2116] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:54.198942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.209233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291790-790e-4e6e-83bf-e86e78180859 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.213831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.214498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.214774 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.215045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] PATH_INFO: `/v3/projects/f831f16d69e04c5abdf8da16d8399b7a/users/995f42f59947487e8e031586058bdd52/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.229773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f831f16d69e04c5abdf8da16d8399b7a, user_id=995f42f59947487e8e031586058bdd52, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.232472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.245673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1043/2117] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:54 2022] PUT /identity/v3/projects/f831f16d69e04c5abdf8da16d8399b7a/users/995f42f59947487e8e031586058bdd52/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:54.249595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.261080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d518ca6-7f54-47c4-ad79-fecb85a4bedc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.315375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582b91-94bb-409a-8839-9a6c79e1ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.315979 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582b91-94bb-409a-8839-9a6c79e1ec0d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.316263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582b91-94bb-409a-8839-9a6c79e1ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.316525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582b91-94bb-409a-8839-9a6c79e1ec0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.317179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582b91-94bb-409a-8839-9a6c79e1ec0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.318766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582b91-94bb-409a-8839-9a6c79e1ec0d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.329153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1075/2118] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:54.333210 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.343338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034538-aeae-4acf-8ffe-115d4e5dc8d4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.347893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.348526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.348800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.349103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] PATH_INFO: `/v3/projects/f831f16d69e04c5abdf8da16d8399b7a/users/995f42f59947487e8e031586058bdd52/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.351231 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f831f16d69e04c5abdf8da16d8399b7a, user_id=995f42f59947487e8e031586058bdd52, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.353859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.364095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1044/2119] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:54 2022] PUT /identity/v3/projects/f831f16d69e04c5abdf8da16d8399b7a/users/995f42f59947487e8e031586058bdd52/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:54.374050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64aa1a-4cf9-43d2-82dd-55e33023463e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.374529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64aa1a-4cf9-43d2-82dd-55e33023463e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.374642 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64aa1a-4cf9-43d2-82dd-55e33023463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.403068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bd64aa1a-4cf9-43d2-82dd-55e33023463e None None] MFA Rules not processed for user `995f42f59947487e8e031586058bdd52`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:54.404265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd64aa1a-4cf9-43d2-82dd-55e33023463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:54.469975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1076/2120] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:54.482658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.484880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:54.543164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ba2d-ea6d-4f0d-8577-3f9450a13a22 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.546802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.547408 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.548190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.548465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.557506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.558922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.568942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1045/2121] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:54.868417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64aa1a-4cf9-43d2-82dd-55e33023463e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.877465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64aa1a-4cf9-43d2-82dd-55e33023463e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.881968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995f42f59947487e8e031586058bdd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f831f16d69e04c5abdf8da16d8399b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.882569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.882850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.883124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.883768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:54.884075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.885700 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.896868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1077/2122] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:54.900941 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.910438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32d2fd-fd7e-4460-a8dc-37d419472d17 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.914951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995f42f59947487e8e031586058bdd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f831f16d69e04c5abdf8da16d8399b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:54.915540 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:54.915820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:54.916092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:54.916746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:54.918678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:54.944697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1046/2123] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:54 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:54.948892 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:54.958518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69854677-fe83-4534-8734-6a575d69a484 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:54.987736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:55.017610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995f42f59947487e8e031586058bdd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f831f16d69e04c5abdf8da16d8399b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:55.018193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:55.018476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:55.018753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:55.019404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:55.019713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:55.021389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:55.034444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1078/2124] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:55.070963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:55.081042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc31bc-a652-4a9d-bc07-3b2d021a75e9 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:55.085491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995f42f59947487e8e031586058bdd52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f831f16d69e04c5abdf8da16d8399b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:55.086102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:55.086381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:55.086654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] PATH_INFO: `/v3/projects/52eba5e4255b48efa9a6c76c415c5580` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:55.087814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52eba5e4255b48efa9a6c76c415c5580)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:55.089801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:55.092059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:55.139687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52eba5e4255b48efa9a6c76c415c5580', 'request_id': 'req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.145756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52eba5e4255b48efa9a6c76c415c5580', 'request_id': 'req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.152856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52eba5e4255b48efa9a6c76c415c5580', 'request_id': 'req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.165109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] The token cache is being invalidate because project 52eba5e4255b48efa9a6c76c415c5580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:55.165418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.166056 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1861c69c-14e2-4ed5-a63c-69ef4a6be07c tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.167536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1047/2125] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:55 2022] DELETE /identity/v3/projects/52eba5e4255b48efa9a6c76c415c5580 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:55.352601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:55.354302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:55.417196 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c589ec0-c395-44f4-b8ed-a488aedc7474 tempest-VolumeQuotaClassesTest-350423184 tempest-VolumeQuotaClassesTest-350423184-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:55.473413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:55.474039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:55.474316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:55.474587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] PATH_INFO: `/v3/users/0c2dbf807cfb4854a794e9008e4f524e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:55.475955 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2dbf807cfb4854a794e9008e4f524e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:55.477919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:55.523851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2dbf807cfb4854a794e9008e4f524e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.530736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2dbf807cfb4854a794e9008e4f524e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.531330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2dbf807cfb4854a794e9008e4f524e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.532008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2dbf807cfb4854a794e9008e4f524e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.544386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2dbf807cfb4854a794e9008e4f524e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:55.546072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:55.557351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1079/2126] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:55 2022] DELETE /identity/v3/users/0c2dbf807cfb4854a794e9008e4f524e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:55.562929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957d1c-e7a3-4a4c-9626-43c2dac87122 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:55.563881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957d1c-e7a3-4a4c-9626-43c2dac87122 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:55.564052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957d1c-e7a3-4a4c-9626-43c2dac87122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:55.583461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-77957d1c-e7a3-4a4c-9626-43c2dac87122 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:55.584653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77957d1c-e7a3-4a4c-9626-43c2dac87122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:55.643453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1048/2127] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:55.654683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:55.656101 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:55.715047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c90024-9774-471c-ba0e-331c133bb753 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:55.718633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:55.719288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:55.719566 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:55.719834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:55.730209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:55.731663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:55.741429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1080/2128] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:56.029697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77957d1c-e7a3-4a4c-9626-43c2dac87122 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:56.041934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77957d1c-e7a3-4a4c-9626-43c2dac87122 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:56.046529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:56.047339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:56.048245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:56.048563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:56.050620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:56.060650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:56.062104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:56.070743 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1049/2129] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:56.165512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:56.167020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:56.181460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299c46-4533-494b-ae5f-a06fdb638101 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:56.186028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:56.186660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:56.186935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:56.187201 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] PATH_INFO: `/v3/projects/1be81714419f47919249abdbd90acaa7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:56.188932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be81714419f47919249abdbd90acaa7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:56.191222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:56.240028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be81714419f47919249abdbd90acaa7', 'request_id': 'req-8a2fc822-cf4e-4a88-a915-698fddcad617'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.248708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be81714419f47919249abdbd90acaa7', 'request_id': 'req-8a2fc822-cf4e-4a88-a915-698fddcad617'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.257526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be81714419f47919249abdbd90acaa7', 'request_id': 'req-8a2fc822-cf4e-4a88-a915-698fddcad617'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.270236 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] The token cache is being invalidate because project 1be81714419f47919249abdbd90acaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:56.270529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.271183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.272684 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1081/2130] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:56 2022] DELETE /identity/v3/projects/1be81714419f47919249abdbd90acaa7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:56.277299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:56.288670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae2714-6f48-4b64-aaa1-efbf3e5a386f service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:56.347011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:56.347641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:56.347915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:56.348180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] PATH_INFO: `/v3/users/995f42f59947487e8e031586058bdd52` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:56.349325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995f42f59947487e8e031586058bdd52)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:56.351489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:56.376913 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:56.405018 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995f42f59947487e8e031586058bdd52'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.405672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995f42f59947487e8e031586058bdd52'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.413400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995f42f59947487e8e031586058bdd52'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.414127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995f42f59947487e8e031586058bdd52'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.427314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995f42f59947487e8e031586058bdd52'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.440431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1050/2131] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:56 2022] DELETE /identity/v3/users/995f42f59947487e8e031586058bdd52 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:56.542538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:56.544064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:56.622792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fc822-cf4e-4a88-a915-698fddcad617 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:56.642035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:56.689097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28e62c-22de-4473-b4ee-422d99cff976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:56.689710 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e62c-22de-4473-b4ee-422d99cff976 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:56.689985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e62c-22de-4473-b4ee-422d99cff976 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:56.690354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e62c-22de-4473-b4ee-422d99cff976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:56.692085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9b28e62c-22de-4473-b4ee-422d99cff976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:56.703389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28e62c-22de-4473-b4ee-422d99cff976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:56.705548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28e62c-22de-4473-b4ee-422d99cff976 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:56.715454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1082/2132] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:56.746959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:56.749186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:56.826220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fac17-4c39-4871-a51c-204536844e36 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:56.831312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:56.831963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:56.832305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:56.832519 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] PATH_INFO: `/v3/projects/f831f16d69e04c5abdf8da16d8399b7a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:56.833705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f831f16d69e04c5abdf8da16d8399b7a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:56.835633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:56.886394 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f831f16d69e04c5abdf8da16d8399b7a', 'request_id': 'req-3d5ae787-0feb-4bef-85cb-94ac34031a42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.893435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f831f16d69e04c5abdf8da16d8399b7a', 'request_id': 'req-3d5ae787-0feb-4bef-85cb-94ac34031a42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.900767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f831f16d69e04c5abdf8da16d8399b7a', 'request_id': 'req-3d5ae787-0feb-4bef-85cb-94ac34031a42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.912428 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] The token cache is being invalidate because project f831f16d69e04c5abdf8da16d8399b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:56.912713 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.913378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3d5ae787-0feb-4bef-85cb-94ac34031a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:56.914832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1051/2133] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:56 2022] DELETE /identity/v3/projects/f831f16d69e04c5abdf8da16d8399b7a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:56.920253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bef155-6e05-4782-9903-aab2bd02230a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:56.920573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bef155-6e05-4782-9903-aab2bd02230a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:56.920852 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bef155-6e05-4782-9903-aab2bd02230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:56.943220 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-31bef155-6e05-4782-9903-aab2bd02230a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:56.944421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-31bef155-6e05-4782-9903-aab2bd02230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.007904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1083/2134] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:57.015791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688cdae-f7d9-4904-8ca2-3170065d3863 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.016119 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688cdae-f7d9-4904-8ca2-3170065d3863 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.017084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688cdae-f7d9-4904-8ca2-3170065d3863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.037064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7688cdae-f7d9-4904-8ca2-3170065d3863 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:57.038249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7688cdae-f7d9-4904-8ca2-3170065d3863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.046333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1052/2135] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:57.050838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bef155-6e05-4782-9903-aab2bd02230a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.061356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bef155-6e05-4782-9903-aab2bd02230a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.066908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.067545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.067825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.068268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.068920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:57.069248 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.070854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.084447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1084/2136] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:57.089023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688cdae-f7d9-4904-8ca2-3170065d3863 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.098377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688cdae-f7d9-4904-8ca2-3170065d3863 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.103487 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.104077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.104351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.104617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.105309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.107201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.129494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:57.136949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1053/2137] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:57 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:57.141189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.151742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe17cf-e832-4d6f-ac92-676bda1b535e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.212357 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.212991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.213282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.213560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.214206 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.216128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.238542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1085/2138] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:57 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:57.242480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.253806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338be92-250b-434c-ba5d-54c057d45d99 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.258615 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.259220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.259500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.259775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.260420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.262048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.272577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1054/2139] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:57.276367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.286807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ee8a1-fdaf-472a-8b76-665328efeef8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.291439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.292042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.292319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.292585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.293288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.294872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.305674 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1086/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:57.309834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.321246 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239ae7e-68ea-450b-91bd-26ca1ce8bef3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.323692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.326404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.329404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68e936-0920-4280-9506-614ac4882147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.330074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e936-0920-4280-9506-614ac4882147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.330349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e936-0920-4280-9506-614ac4882147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.330607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e936-0920-4280-9506-614ac4882147 admin admin] PATH_INFO: `/v3/projects/e7038738c25740efb5fdbd72b392eb2a/users/fb29b6888f814e5e85f38834420091aa/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.347415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:57.349814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68e936-0920-4280-9506-614ac4882147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7038738c25740efb5fdbd72b392eb2a, user_id=fb29b6888f814e5e85f38834420091aa, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.353688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68e936-0920-4280-9506-614ac4882147 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.368841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1055/2141] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:57 2022] PUT /identity/v3/projects/e7038738c25740efb5fdbd72b392eb2a/users/fb29b6888f814e5e85f38834420091aa/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:57.381492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.381778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.382075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.412274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9f79f-ee6d-413e-acbc-e216c5348bda admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.412729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] MFA Rules not processed for user `fb29b6888f814e5e85f38834420091aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:57.414036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.480585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.481345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.481623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.481890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.483071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1056/2142] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:57.484519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.494746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.496190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.556043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.557350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.559409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36c9f-27d2-4301-97bc-55a3341f5df4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.565089 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4783b5-4289-40e3-b5af-2a2bda56454a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.565999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4783b5-4289-40e3-b5af-2a2bda56454a service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.566367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4783b5-4289-40e3-b5af-2a2bda56454a service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.566647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4783b5-4289-40e3-b5af-2a2bda56454a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.568900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1087/2143] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:57.576244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4783b5-4289-40e3-b5af-2a2bda56454a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.578145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4783b5-4289-40e3-b5af-2a2bda56454a service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.588386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1057/2144] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:16:57.611288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.665986 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:57.679042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a72635-7dfd-48ae-9311-e7d18c92ab0a service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.683862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.684490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.684767 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.685077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] PATH_INFO: `/v3/users/fb29b6888f814e5e85f38834420091aa` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.686350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb29b6888f814e5e85f38834420091aa)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.689126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.746498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb29b6888f814e5e85f38834420091aa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.754584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb29b6888f814e5e85f38834420091aa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.755278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb29b6888f814e5e85f38834420091aa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.755948 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb29b6888f814e5e85f38834420091aa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.769125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb29b6888f814e5e85f38834420091aa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.783252 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1088/2145] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:57 2022] DELETE /identity/v3/users/fb29b6888f814e5e85f38834420091aa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:57.787694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.788159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.788272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.809569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:57.810854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.877603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:57.897223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1058/2146] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:57.906533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.908751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.972195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6d5b-0c9b-4ace-a41d-c9bb6f28cb59 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.976261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9e263-8c25-4777-abd9-66dbaea1131a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.976872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e263-8c25-4777-abd9-66dbaea1131a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.977203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e263-8c25-4777-abd9-66dbaea1131a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.977482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e263-8c25-4777-abd9-66dbaea1131a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.988645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9e263-8c25-4777-abd9-66dbaea1131a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.990733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9e263-8c25-4777-abd9-66dbaea1131a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.001689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1089/2147] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:58.436605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.438673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:58.450915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f5e6-a268-4657-b2d1-c37ad4a4513f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.455682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.456321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.456603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.456869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] PATH_INFO: `/v3/projects/e7038738c25740efb5fdbd72b392eb2a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.458245 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7038738c25740efb5fdbd72b392eb2a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.460164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.517312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7038738c25740efb5fdbd72b392eb2a', 'request_id': 'req-96650dc2-ea10-4c72-8238-07cc253af3ba'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:58.523191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7038738c25740efb5fdbd72b392eb2a', 'request_id': 'req-96650dc2-ea10-4c72-8238-07cc253af3ba'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:58.531511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7038738c25740efb5fdbd72b392eb2a', 'request_id': 'req-96650dc2-ea10-4c72-8238-07cc253af3ba'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:58.545176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] The token cache is being invalidate because project e7038738c25740efb5fdbd72b392eb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:58.545473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:58.546138 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-96650dc2-ea10-4c72-8238-07cc253af3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:58.548552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1059/2148] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:58 2022] DELETE /identity/v3/projects/e7038738c25740efb5fdbd72b392eb2a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:58.554333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19be2e-c2de-4d2b-a26a-aa67743cd3e3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.554620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19be2e-c2de-4d2b-a26a-aa67743cd3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.555542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19be2e-c2de-4d2b-a26a-aa67743cd3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.576925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ae19be2e-c2de-4d2b-a26a-aa67743cd3e3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:58.578702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ae19be2e-c2de-4d2b-a26a-aa67743cd3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:58.648330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1090/2149] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:58.656212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6cbb1-e711-4d20-be08-3161214b4244 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.656496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6cbb1-e711-4d20-be08-3161214b4244 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.657344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6cbb1-e711-4d20-be08-3161214b4244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.677992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-80b6cbb1-e711-4d20-be08-3161214b4244 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:58.679191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-80b6cbb1-e711-4d20-be08-3161214b4244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:58.687847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1060/2150] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:58.692068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19be2e-c2de-4d2b-a26a-aa67743cd3e3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.702235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19be2e-c2de-4d2b-a26a-aa67743cd3e3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.707370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.707560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.707768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.708038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.708693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:58.709006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.710602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.720385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:58.728567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1091/2151] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:58.729718 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6cbb1-e711-4d20-be08-3161214b4244 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.741604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6cbb1-e711-4d20-be08-3161214b4244 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.746398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.747023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.747297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.747562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.748181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.750097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.780625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1061/2152] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:58.785345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.802244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b165bcc-e60b-4d22-8579-eeee317094d9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.866106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.866797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.867269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.867659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.868452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.870482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.897764 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1092/2153] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:16:58.901936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.915199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694084-2a37-4919-8d61-4f4da5f17d18 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.920425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.921222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.921560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.921902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.922670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.924574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.940829 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1062/2154] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:58.942081 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.954673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1340b-9c67-4a53-87b4-c92974b187d6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.961630 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f842cd-783c-468a-8504-ab88f49e2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.963003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f842cd-783c-468a-8504-ab88f49e2c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.963214 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f842cd-783c-468a-8504-ab88f49e2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.963519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f842cd-783c-468a-8504-ab88f49e2c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.964484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f842cd-783c-468a-8504-ab88f49e2c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.966643 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f842cd-783c-468a-8504-ab88f49e2c48 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.985285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1093/2155] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:58.987063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:59.002832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5f248-436b-4201-b5e7-ccd501ce536c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:59.010077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:59.010752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:59.011028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:59.011340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] PATH_INFO: `/v3/projects/11b107a5a9524b079ab7a2da1d07a857/users/5de9bf7985e243c6bd8bcbc3f9dedacf/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:59.038286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b107a5a9524b079ab7a2da1d07a857, user_id=5de9bf7985e243c6bd8bcbc3f9dedacf, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:59.041054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:59.055569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1063/2156] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:58 2022] PUT /identity/v3/projects/11b107a5a9524b079ab7a2da1d07a857/users/5de9bf7985e243c6bd8bcbc3f9dedacf/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:59.066636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:59.066927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:59.067208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:59.100927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] MFA Rules not processed for user `5de9bf7985e243c6bd8bcbc3f9dedacf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:59.102239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:59.183683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1094/2157] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:16:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:59.194550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:59.196219 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:59.254821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44155-4f97-4134-aa28-b975f81f87a9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:59.258452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:59.259058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:59.259340 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:59.259638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:59.269001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:59.270436 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:59.279562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1064/2158] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:59.682112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:59.683810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:59.783413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e336ae-0d1e-4aa4-a6eb-271226188576 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:59.789420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:59.790028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:59.790302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:59.790573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:59.792422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:59.801921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:59.806803 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:59.809336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:59.823091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1095/2159] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:59.993985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:59.995294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:00.012644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c656607-bf0c-4404-9a5d-a6d94d00cc93 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:00.019412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0e256-fa22-424a-bef6-2bae6bf495fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:00.020435 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0e256-fa22-424a-bef6-2bae6bf495fc service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:00.021162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0e256-fa22-424a-bef6-2bae6bf495fc service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:00.021599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0e256-fa22-424a-bef6-2bae6bf495fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:00.023649 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4ef0e256-fa22-424a-bef6-2bae6bf495fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:00.050931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:00.099853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0e256-fa22-424a-bef6-2bae6bf495fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:00.101827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0e256-fa22-424a-bef6-2bae6bf495fc service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:00.114539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1065/2160] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:04.647333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:04.708081 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0ee5c-1c18-48d4-b654-3ab4e36cd73f service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:04.712656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:04.713161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:04.713441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:04.713710 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] PATH_INFO: `/v3/users/5de9bf7985e243c6bd8bcbc3f9dedacf` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:04.714899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de9bf7985e243c6bd8bcbc3f9dedacf)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:04.716810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:04.765463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de9bf7985e243c6bd8bcbc3f9dedacf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:04.772701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de9bf7985e243c6bd8bcbc3f9dedacf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:04.773469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de9bf7985e243c6bd8bcbc3f9dedacf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:04.774111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de9bf7985e243c6bd8bcbc3f9dedacf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:04.786789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de9bf7985e243c6bd8bcbc3f9dedacf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:04.801044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1096/2161] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:04 2022] DELETE /identity/v3/users/5de9bf7985e243c6bd8bcbc3f9dedacf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:04.806459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:04.806915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:04.807023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:04.827308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:04.828625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:04.894776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1066/2162] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:04.904590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:04.906150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:04.963739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7cf77-e962-4488-85cd-cea7398e0f84 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:04.967338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae304e-2f50-4863-8dea-842103fdec86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:04.967970 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae304e-2f50-4863-8dea-842103fdec86 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:04.968242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae304e-2f50-4863-8dea-842103fdec86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:04.968510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae304e-2f50-4863-8dea-842103fdec86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:04.978477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae304e-2f50-4863-8dea-842103fdec86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:04.979889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae304e-2f50-4863-8dea-842103fdec86 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:04.989326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1097/2163] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:05.287570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.289047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:05.304118 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5119-8c02-4926-b411-37e9ef82dc4d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:05.308838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:05.309468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.309775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.310099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] PATH_INFO: `/v3/projects/11b107a5a9524b079ab7a2da1d07a857` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.311197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b107a5a9524b079ab7a2da1d07a857)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:05.313101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:05.358922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b107a5a9524b079ab7a2da1d07a857', 'request_id': 'req-643444dc-c771-4e40-8cc0-c808c4f0cbc9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:05.365109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b107a5a9524b079ab7a2da1d07a857', 'request_id': 'req-643444dc-c771-4e40-8cc0-c808c4f0cbc9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:05.372356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b107a5a9524b079ab7a2da1d07a857', 'request_id': 'req-643444dc-c771-4e40-8cc0-c808c4f0cbc9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:05.383644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] The token cache is being invalidate because project 11b107a5a9524b079ab7a2da1d07a857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:05.383927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:05.384547 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-643444dc-c771-4e40-8cc0-c808c4f0cbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:05.386062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1067/2164] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:05 2022] DELETE /identity/v3/projects/11b107a5a9524b079ab7a2da1d07a857 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:05.390881 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed882fc-14c0-43ce-a48c-ac159cef5c4b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.391168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed882fc-14c0-43ce-a48c-ac159cef5c4b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.391444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed882fc-14c0-43ce-a48c-ac159cef5c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.412232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5ed882fc-14c0-43ce-a48c-ac159cef5c4b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:05.413462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5ed882fc-14c0-43ce-a48c-ac159cef5c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:05.423330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:05.474394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1098/2165] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:05.482367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f148eb-1612-4eb2-be07-367cf00e9da5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.482651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f148eb-1612-4eb2-be07-367cf00e9da5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.482925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f148eb-1612-4eb2-be07-367cf00e9da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.503100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e8f148eb-1612-4eb2-be07-367cf00e9da5 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:05.504424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e8f148eb-1612-4eb2-be07-367cf00e9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:05.512267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1068/2166] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:05.516418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed882fc-14c0-43ce-a48c-ac159cef5c4b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.526227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed882fc-14c0-43ce-a48c-ac159cef5c4b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:05.530796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:05.531930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.532341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.532478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.533274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:05.533455 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:05.535040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:05.547091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1099/2167] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:17:05.552182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f148eb-1612-4eb2-be07-367cf00e9da5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.561525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f148eb-1612-4eb2-be07-367cf00e9da5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:05.566472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:05.567065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.567336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.567602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.568384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:05.570305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:05.601017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1069/2168] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:05 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:17:05.603228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.613846 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3f235-3424-4bf8-9cea-e0b3fac95f66 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:05.672277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:05.672927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.673243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.673517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.674140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:05.676415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:05.698441 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1100/2169] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:05 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:05.702399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.713820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453af2dc-34ef-4f27-8f2d-bc1e0490ada5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:05.721416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:05.722015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.722290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.722561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.723192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:05.724768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:05.735372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1070/2170] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:05.739598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.751638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bb717-87f3-4e74-899e-8baceb91d9c0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:05.757282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf00c4-57b3-4645-9a9a-d8172794f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:05.757898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf00c4-57b3-4645-9a9a-d8172794f12a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.758179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf00c4-57b3-4645-9a9a-d8172794f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.758451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf00c4-57b3-4645-9a9a-d8172794f12a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.759277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf00c4-57b3-4645-9a9a-d8172794f12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:05.761009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf00c4-57b3-4645-9a9a-d8172794f12a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:05.773085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1101/2171] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:05.776882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.783726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:05.790159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4d10-4c90-40f5-af5a-0026347c4865 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:05.797492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:05.798253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.798541 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.798872 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] PATH_INFO: `/v3/projects/7246c2c09e064411900fb9b5ce391e6a/users/69ebcf96dd6d4e74a777604c919b3198/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.817382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7246c2c09e064411900fb9b5ce391e6a, user_id=69ebcf96dd6d4e74a777604c919b3198, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:05.820315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:05.846818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1071/2172] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:05 2022] PUT /identity/v3/projects/7246c2c09e064411900fb9b5ce391e6a/users/69ebcf96dd6d4e74a777604c919b3198/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:05.852391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:05.852844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:05.853168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:05.874309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:05.875568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:05.946280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:05.948111 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:06.003069 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1102/2173] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:06.018296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:06.034378 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:06.045144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6eb84b-c46f-4482-97df-f2805df4dde6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:06.051505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd5b46-8446-48cd-b5a8-154e4cc6a5f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:06.052646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5b46-8446-48cd-b5a8-154e4cc6a5f2 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:06.053064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5b46-8446-48cd-b5a8-154e4cc6a5f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:06.053436 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5b46-8446-48cd-b5a8-154e4cc6a5f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:06.055515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-80dd5b46-8446-48cd-b5a8-154e4cc6a5f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:06.069720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:06.071253 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd5b46-8446-48cd-b5a8-154e4cc6a5f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:06.073122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd5b46-8446-48cd-b5a8-154e4cc6a5f2 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:06.086820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1072/2174] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:06.112521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be310cf-0e33-49ae-b528-97a9918ba902 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:06.116783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:06.117450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:06.117729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:06.118018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:06.128516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:06.130007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:06.140429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1103/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:06.816616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c42a-25e9-433d-8901-aa0d91247044 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:06.816864 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c42a-25e9-433d-8901-aa0d91247044 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:06.817131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c42a-25e9-433d-8901-aa0d91247044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:06.845297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9003c42a-25e9-433d-8901-aa0d91247044 None None] MFA Rules not processed for user `69ebcf96dd6d4e74a777604c919b3198`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:06.848556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9003c42a-25e9-433d-8901-aa0d91247044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:06.920800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1073/2176] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:06.932159 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:06.933717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:07.000655 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3c4f2-847e-4c24-97ba-334654ee09b9 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:07.004183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:07.004806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:07.005117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:07.005389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:07.014486 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:07.015941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:07.026921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1104/2177] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:08.463251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:08.463847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:08.463989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:08.494191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] MFA Rules not processed for user `69ebcf96dd6d4e74a777604c919b3198`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:08.495881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:08.504139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1074/2178] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:08.783150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:08.792841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e407a7-abd5-4a33-b6e4-0c5d279bd26b service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:08.796666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddd595-0c6c-49a7-9a79-c2e9b40df94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:08.797379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd595-0c6c-49a7-9a79-c2e9b40df94a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:08.797659 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd595-0c6c-49a7-9a79-c2e9b40df94a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:08.797931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd595-0c6c-49a7-9a79-c2e9b40df94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:08.799728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c8ddd595-0c6c-49a7-9a79-c2e9b40df94a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:08.809512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddd595-0c6c-49a7-9a79-c2e9b40df94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:08.811030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddd595-0c6c-49a7-9a79-c2e9b40df94a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:08.819223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1105/2179] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:08.916207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:08.917669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:08.937648 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69104c72-7982-4ab0-a726-2797cf5c2ee8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:08.943809 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:08.944517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:08.944802 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:08.945240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:08.948883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:08.999239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:09.023470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:09.025465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:09.035372 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1075/2180] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:18.816176 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=48 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:19.030586 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=9 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:19.408191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217b0c-141d-4b3c-8075-51625216e626 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:19.408488 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217b0c-141d-4b3c-8075-51625216e626 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:19.408759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217b0c-141d-4b3c-8075-51625216e626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:19.429569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a217b0c-141d-4b3c-8075-51625216e626 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:19.430954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a217b0c-141d-4b3c-8075-51625216e626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:19.492918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1106/2181] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:17:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:19.507180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:19.508577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:19.584282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686d56-0163-4b97-b6c7-d288fbabd229 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:19.589155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:19.589755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:19.590028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:19.590296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:19.598659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:19.600483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:19.610319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1076/2182] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:17:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:21.685019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a217b0c-141d-4b3c-8075-51625216e626 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:21.696127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a217b0c-141d-4b3c-8075-51625216e626 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:21.700278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:21.700989 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:21.701344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:21.701691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:21.704117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:21.717356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:21.719552 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:21.730457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1107/2183] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:26.715581 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:26.716509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:26.734067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873e0a-3f34-465e-ae64-c56233d4b7fe service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:26.740662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:26.764449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:26.765748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:26.767596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] PATH_INFO: `/v3/users/3b1d073ea32449458376dea2ab919a48` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:26.773871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1d073ea32449458376dea2ab919a48)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:26.781396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:26.869861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1d073ea32449458376dea2ab919a48'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:26.870603 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1d073ea32449458376dea2ab919a48'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:26.880196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1d073ea32449458376dea2ab919a48'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:26.880900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1d073ea32449458376dea2ab919a48'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:26.898666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5f5f91b3-9edd-4f5a-9105-6829f5968fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1d073ea32449458376dea2ab919a48'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:26.912714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1077/2184] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:26 2022] DELETE /identity/v3/users/3b1d073ea32449458376dea2ab919a48 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:27.131424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:27.142207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe29674-863a-4730-9e97-2e29de625849 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:27.221364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:27.222660 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.223144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.223626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] PATH_INFO: `/v3/projects/5506be3c5f8b40818fbac09a1e205a47` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.225167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5506be3c5f8b40818fbac09a1e205a47)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:27.227184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:27.292782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5506be3c5f8b40818fbac09a1e205a47', 'request_id': 'req-9f801310-c476-4e27-94bb-94ceda06caab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:27.304168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5506be3c5f8b40818fbac09a1e205a47', 'request_id': 'req-9f801310-c476-4e27-94bb-94ceda06caab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:27.311468 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5506be3c5f8b40818fbac09a1e205a47', 'request_id': 'req-9f801310-c476-4e27-94bb-94ceda06caab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:27.324869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] The token cache is being invalidate because project 5506be3c5f8b40818fbac09a1e205a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:27.325883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:27.326932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9f801310-c476-4e27-94bb-94ceda06caab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:27.329628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1108/2185] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:27 2022] DELETE /identity/v3/projects/5506be3c5f8b40818fbac09a1e205a47 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:27.334645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb05bf-06f2-43c2-abff-fe8b0a999ddb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.334932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb05bf-06f2-43c2-abff-fe8b0a999ddb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.335223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb05bf-06f2-43c2-abff-fe8b0a999ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.357185 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-77fb05bf-06f2-43c2-abff-fe8b0a999ddb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:27.359204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77fb05bf-06f2-43c2-abff-fe8b0a999ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:27.440815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1078/2186] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:27.448801 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb902-d6bb-4b6e-bd64-33e32d6a964e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.449457 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb902-d6bb-4b6e-bd64-33e32d6a964e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.450017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb902-d6bb-4b6e-bd64-33e32d6a964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.473912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ce8fb902-d6bb-4b6e-bd64-33e32d6a964e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:27.475682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ce8fb902-d6bb-4b6e-bd64-33e32d6a964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:27.488739 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1109/2187] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:27.492705 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb05bf-06f2-43c2-abff-fe8b0a999ddb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:27.497984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:27.508853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb05bf-06f2-43c2-abff-fe8b0a999ddb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:27.515852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:27.516717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.518599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.519159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.519925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:27.520339 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:27.522164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:27.536143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1079/2188] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:17:27.540168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fb902-d6bb-4b6e-bd64-33e32d6a964e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:27.556156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fb902-d6bb-4b6e-bd64-33e32d6a964e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:27.562830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:27.563657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.564112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.564568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.572744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:27.577667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:27.615107 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:27.640446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1110/2189] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:27 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:27.644096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:27.655013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fee6a-20bd-4bc7-83da-fa43a0610a48 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:27.737534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:27.738290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.738697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.739049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.739788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:27.744363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:27.774361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1080/2190] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:27 2022] POST /identity/v3/users => generated 279 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:27.778376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:27.789963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c56a0-45f3-4dbe-9278-b8f9cd00ec36 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:27.794896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:27.795584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.795941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.796866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.797636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:27.799359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:27.812134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1111/2191] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:27.815274 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:27.830720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62153-f5e5-4a79-9f5d-f23e2e32f84d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:27.836101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ad42-58f2-47b5-9f20-53a33c8b938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:27.836797 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ad42-58f2-47b5-9f20-53a33c8b938d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.837221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ad42-58f2-47b5-9f20-53a33c8b938d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.837574 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ad42-58f2-47b5-9f20-53a33c8b938d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.838409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725ad42-58f2-47b5-9f20-53a33c8b938d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:27.840100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725ad42-58f2-47b5-9f20-53a33c8b938d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:27.855521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1081/2192] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:27.865058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:27.890100 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007be67f-9fa2-4644-88c1-303affa24b78 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:27.898115 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:27.898792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.899307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.899578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] PATH_INFO: `/v3/projects/bb2f2e6f4cb8461fb0aef12e356575b6/users/f04e0885992f411a84c50acf3789f3e8/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:27.927853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2f2e6f4cb8461fb0aef12e356575b6, user_id=f04e0885992f411a84c50acf3789f3e8, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:27.932471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:27.958611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1112/2193] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:27 2022] PUT /identity/v3/projects/bb2f2e6f4cb8461fb0aef12e356575b6/users/f04e0885992f411a84c50acf3789f3e8/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:27.970432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e3ceb-1ba8-422f-ac31-8e8db2e9a63c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:27.970950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e3ceb-1ba8-422f-ac31-8e8db2e9a63c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:27.971538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e3ceb-1ba8-422f-ac31-8e8db2e9a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.018984 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-011e3ceb-1ba8-422f-ac31-8e8db2e9a63c None None] MFA Rules not processed for user `f04e0885992f411a84c50acf3789f3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:28.020691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-011e3ceb-1ba8-422f-ac31-8e8db2e9a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:28.134847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1082/2194] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:28.135437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:28.213689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8130840-0a71-4608-836d-2e2fde9b6141 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:28.218824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:28.219682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:28.220041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:28.220389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.221137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:28.223158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:28.255794 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1113/2195] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:28 2022] POST /identity/v3/projects => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:28.260137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e3ceb-1ba8-422f-ac31-8e8db2e9a63c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:28.271659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e3ceb-1ba8-422f-ac31-8e8db2e9a63c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:28.330936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:28.341276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:28.342187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:28.342647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:28.343115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.343781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:28.345750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:28.369798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1083/2196] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:28 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:28.373605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:28.389449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d0eba-76d5-4867-a253-9169e5192c8d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:28.394729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:28.396451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:28.396451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:28.396451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.396804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:28.398742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:28.410443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1114/2197] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:28.414529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:28.427511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b89ec-df61-43d0-9b47-c9a0ce4a74a0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:28.435095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:28.435870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:28.436151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:28.436421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] PATH_INFO: `/v3/projects/e88d8d17ff944d149c53bb5200a43976/users/6e481590ee174099a9d431e6282efd85/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.454262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88d8d17ff944d149c53bb5200a43976, user_id=6e481590ee174099a9d431e6282efd85, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:28.456922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:28.477205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1084/2198] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:28 2022] PUT /identity/v3/projects/e88d8d17ff944d149c53bb5200a43976/users/6e481590ee174099a9d431e6282efd85/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:28.478156 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:28.489289 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9a929-e545-4e3c-9bf8-47bbb77ca06a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:28.566276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5adb-7d14-41db-9cf3-5ef712f8d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:28.566968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5adb-7d14-41db-9cf3-5ef712f8d2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:28.567170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5adb-7d14-41db-9cf3-5ef712f8d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:28.567428 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5adb-7d14-41db-9cf3-5ef712f8d2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.568129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5adb-7d14-41db-9cf3-5ef712f8d2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:28.569981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5adb-7d14-41db-9cf3-5ef712f8d2e5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:28.585834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1115/2199] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:28.587373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:28.609842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64483a3-8667-46cb-a8ce-7c4ae15fa903 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:28.617788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:28.618807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:28.619305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:28.619823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] PATH_INFO: `/v3/projects/e88d8d17ff944d149c53bb5200a43976/users/6e481590ee174099a9d431e6282efd85/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.624511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88d8d17ff944d149c53bb5200a43976, user_id=6e481590ee174099a9d431e6282efd85, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:28.628788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:28.669847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1085/2200] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:28 2022] PUT /identity/v3/projects/e88d8d17ff944d149c53bb5200a43976/users/6e481590ee174099a9d431e6282efd85/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:28.683688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:28.683950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:28.684229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:28.764044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] MFA Rules not processed for user `6e481590ee174099a9d431e6282efd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:28.765387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:28.788286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:28.887170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1116/2201] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:28.899092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:28.900873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:29.020677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ac12-23ec-47ee-9631-3348bab3e92c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:29.026049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f4d8d-18ed-4520-a2ba-a8bcc0d3951e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:29.026675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f4d8d-18ed-4520-a2ba-a8bcc0d3951e service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:29.027473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f4d8d-18ed-4520-a2ba-a8bcc0d3951e service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:29.027760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f4d8d-18ed-4520-a2ba-a8bcc0d3951e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:29.045257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f4d8d-18ed-4520-a2ba-a8bcc0d3951e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:29.046870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f4d8d-18ed-4520-a2ba-a8bcc0d3951e service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:29.060125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1086/2202] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:29.186682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:29.188142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:29.219102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6658a-12a1-4151-88c8-a9b5d815ff03 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:29.226129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304409a-c24a-4c7c-a7cc-dfb5d998e35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:29.227887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304409a-c24a-4c7c-a7cc-dfb5d998e35e service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:29.228166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304409a-c24a-4c7c-a7cc-dfb5d998e35e service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:29.228913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304409a-c24a-4c7c-a7cc-dfb5d998e35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:29.348904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304409a-c24a-4c7c-a7cc-dfb5d998e35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:29.350744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304409a-c24a-4c7c-a7cc-dfb5d998e35e service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:29.364094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1117/2203] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:31.448619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623598-8e07-4b99-a30f-126fa3a92a2d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:31.448619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623598-8e07-4b99-a30f-126fa3a92a2d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:31.448619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623598-8e07-4b99-a30f-126fa3a92a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:31.466810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-75623598-8e07-4b99-a30f-126fa3a92a2d None None] MFA Rules not processed for user `69ebcf96dd6d4e74a777604c919b3198`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:31.468104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-75623598-8e07-4b99-a30f-126fa3a92a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:31.529833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1087/2204] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:38.034827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbad71a-0c6f-4637-b9ea-d0dd0221d168 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.035390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbad71a-0c6f-4637-b9ea-d0dd0221d168 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.035909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbad71a-0c6f-4637-b9ea-d0dd0221d168 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.037569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1118/2205] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:17:38.043657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e39a-8d32-4b24-9a90-c0d994549510 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.044171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e39a-8d32-4b24-9a90-c0d994549510 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.044280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e39a-8d32-4b24-9a90-c0d994549510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.066708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3388e39a-8d32-4b24-9a90-c0d994549510 None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:38.068015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3388e39a-8d32-4b24-9a90-c0d994549510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:38.136315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:38.157889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1088/2206] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:17:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:38.182338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbad71a-0c6f-4637-b9ea-d0dd0221d168 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:38.184515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8bbad71a-0c6f-4637-b9ea-d0dd0221d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:38.259471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbad71a-0c6f-4637-b9ea-d0dd0221d168 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:38.269431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcf4ba-ebe9-41ad-9ad0-d3eb75003961 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:38.269431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf4ba-ebe9-41ad-9ad0-d3eb75003961 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.269431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf4ba-ebe9-41ad-9ad0-d3eb75003961 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.269431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcf4ba-ebe9-41ad-9ad0-d3eb75003961 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.282675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcf4ba-ebe9-41ad-9ad0-d3eb75003961 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:38.284148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcf4ba-ebe9-41ad-9ad0-d3eb75003961 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:38.299305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1119/2207] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:38.382610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c55f-3751-4a38-93fe-425b9281948a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.383010 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c55f-3751-4a38-93fe-425b9281948a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.383285 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c55f-3751-4a38-93fe-425b9281948a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.384643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1089/2208] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:17:38.390242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869324a9-64c1-4bf8-8da2-502094322193 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.390661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869324a9-64c1-4bf8-8da2-502094322193 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.391038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869324a9-64c1-4bf8-8da2-502094322193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.412951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-869324a9-64c1-4bf8-8da2-502094322193 None None] MFA Rules not processed for user `1dc28ef7b36746208560692b17809e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:38.415313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-869324a9-64c1-4bf8-8da2-502094322193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:38.466116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1120/2209] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:17:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:38.478227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29c55f-3751-4a38-93fe-425b9281948a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:38.479976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e29c55f-3751-4a38-93fe-425b9281948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:38.496432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29c55f-3751-4a38-93fe-425b9281948a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:38.500708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008fb8-a65a-49e4-9436-50ceff72e7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:38.501425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008fb8-a65a-49e4-9436-50ceff72e7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.501771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008fb8-a65a-49e4-9436-50ceff72e7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.502135 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008fb8-a65a-49e4-9436-50ceff72e7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.509431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14008fb8-a65a-49e4-9436-50ceff72e7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:38.510859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14008fb8-a65a-49e4-9436-50ceff72e7c7 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:38.519231 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1090/2210] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:38.600918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3a9d-3bb5-499e-bd1f-e8404285c647 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.601342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3a9d-3bb5-499e-bd1f-e8404285c647 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.601673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3a9d-3bb5-499e-bd1f-e8404285c647 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.603210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1121/2211] 10.222.0.25 () {54 vars in 921 bytes} [Sun Oct 23 02:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:17:38.609508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c700-bbab-49a6-a848-70e30ae5375b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.609789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c700-bbab-49a6-a848-70e30ae5375b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.610055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1c700-bbab-49a6-a848-70e30ae5375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.630482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-55a1c700-bbab-49a6-a848-70e30ae5375b None None] MFA Rules not processed for user `96fb635cda454c4a89badd09b8396ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:38.631674 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-55a1c700-bbab-49a6-a848-70e30ae5375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:38.642377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1091/2212] 10.222.0.25 () {58 vars in 1018 bytes} [Sun Oct 23 02:17:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:38.652531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3a9d-3bb5-499e-bd1f-e8404285c647 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:38.660502 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:38.665683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3a9d-3bb5-499e-bd1f-e8404285c647 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:38.669277 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:38.669882 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:38.670162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:38.670438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:38.681163 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:38.682590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:38.694158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1122/2213] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:40.586813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:40.587651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:40.588121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:40.614052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:40.615619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:40.673553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1092/2214] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:17:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:40.696079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:40.697526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:40.769903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa6832-676e-4fc4-aa7d-c6d22181eee4 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:40.774956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:40.775506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:40.775789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:40.776063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:40.784042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:40.785662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:40.793637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1123/2215] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:17:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 02:17:41.608868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:41.610793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:41.630441 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4851b5-7515-4e53-8e80-1e3ed9c1e64f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:41.642361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09205456-dc80-4ab6-9a1b-a74336c82316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:41.643176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09205456-dc80-4ab6-9a1b-a74336c82316 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:41.643605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09205456-dc80-4ab6-9a1b-a74336c82316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:41.644041 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09205456-dc80-4ab6-9a1b-a74336c82316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:41.658081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-09205456-dc80-4ab6-9a1b-a74336c82316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:41.743934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09205456-dc80-4ab6-9a1b-a74336c82316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:41.745949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09205456-dc80-4ab6-9a1b-a74336c82316 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:41.758608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1093/2216] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:46.244819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.260059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4bca-daa6-402d-b4f7-6eba402e312a service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.272359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.273071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.273359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.274957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] PATH_INFO: `/v3/users/f04e0885992f411a84c50acf3789f3e8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.276427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04e0885992f411a84c50acf3789f3e8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.278788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.378508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04e0885992f411a84c50acf3789f3e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.394012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04e0885992f411a84c50acf3789f3e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.396252 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04e0885992f411a84c50acf3789f3e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.398175 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04e0885992f411a84c50acf3789f3e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.433000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04e0885992f411a84c50acf3789f3e8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.455034 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1124/2217] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:46 2022] DELETE /identity/v3/users/f04e0885992f411a84c50acf3789f3e8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:46.459242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193106-146e-498f-b233-49c05407d193 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.459749 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193106-146e-498f-b233-49c05407d193 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.459871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193106-146e-498f-b233-49c05407d193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.484127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ac193106-146e-498f-b233-49c05407d193 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:46.485524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ac193106-146e-498f-b233-49c05407d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:46.593560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1094/2218] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:46.605567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.608376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:46.743624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55ddd-119c-4a45-ae21-a6cc675e0f2f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.747512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.748251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.748613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.748942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.766583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:46.773563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.777149 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.799234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1125/2219] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:47.385512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193106-146e-498f-b233-49c05407d193 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:47.388030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ac193106-146e-498f-b233-49c05407d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:47.430769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193106-146e-498f-b233-49c05407d193 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:47.450909 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:47.453020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:47.453368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:47.453567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] PATH_INFO: `/v3/projects/bb2f2e6f4cb8461fb0aef12e356575b6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:47.455735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2f2e6f4cb8461fb0aef12e356575b6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:47.463827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:47.469448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:47.567929 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2f2e6f4cb8461fb0aef12e356575b6', 'request_id': 'req-fcd8c416-8891-41d6-b0df-cb681163ec0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.602432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2f2e6f4cb8461fb0aef12e356575b6', 'request_id': 'req-fcd8c416-8891-41d6-b0df-cb681163ec0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.614974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2f2e6f4cb8461fb0aef12e356575b6', 'request_id': 'req-fcd8c416-8891-41d6-b0df-cb681163ec0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.641040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] The token cache is being invalidate because project bb2f2e6f4cb8461fb0aef12e356575b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:47.641716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.642754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.645249 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1095/2220] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:47 2022] DELETE /identity/v3/projects/bb2f2e6f4cb8461fb0aef12e356575b6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:47.651285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:47.672150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47a85e-6996-45ba-855f-bee3f67f6e44 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:47.784058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:47.784773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:47.785114 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:47.785450 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] PATH_INFO: `/v3/users/6e481590ee174099a9d431e6282efd85` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:47.798209 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e481590ee174099a9d431e6282efd85)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:47.807835 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:47.879590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e481590ee174099a9d431e6282efd85'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.891010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e481590ee174099a9d431e6282efd85'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.891759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e481590ee174099a9d431e6282efd85'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.892413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e481590ee174099a9d431e6282efd85'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.908164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e481590ee174099a9d431e6282efd85'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:47.928821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1126/2221] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:47 2022] DELETE /identity/v3/users/6e481590ee174099a9d431e6282efd85 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:48.042533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:48.044633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:48.070414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c416-8891-41d6-b0df-cb681163ec0f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:48.184620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:48.185898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:48.186183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:48.186464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] PATH_INFO: `/v3/users/ab8ab12109f34f0ab1d13b1cf2d375d0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:48.189879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8ab12109f34f0ab1d13b1cf2d375d0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:48.192405 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:48.299839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8ab12109f34f0ab1d13b1cf2d375d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.300668 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8ab12109f34f0ab1d13b1cf2d375d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.310934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8ab12109f34f0ab1d13b1cf2d375d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.312183 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8ab12109f34f0ab1d13b1cf2d375d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.328187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8ab12109f34f0ab1d13b1cf2d375d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.349707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1096/2222] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:48 2022] DELETE /identity/v3/users/ab8ab12109f34f0ab1d13b1cf2d375d0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:48.358626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:48.360454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:48.392691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490ae2-c87e-4acb-8bec-14afd85509bd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:48.531415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:48.533154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:48.533733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:48.534210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] PATH_INFO: `/v3/projects/e88d8d17ff944d149c53bb5200a43976` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:48.536241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88d8d17ff944d149c53bb5200a43976)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:48.540192 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:48.588207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:48.641556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88d8d17ff944d149c53bb5200a43976', 'request_id': 'req-237672d0-87e5-4413-82dc-1211f8ce0cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.658594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:48.660300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:48.663656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88d8d17ff944d149c53bb5200a43976', 'request_id': 'req-237672d0-87e5-4413-82dc-1211f8ce0cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.680779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65945-f9bc-473a-a27c-71f5f36f8036 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:48.683382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88d8d17ff944d149c53bb5200a43976', 'request_id': 'req-237672d0-87e5-4413-82dc-1211f8ce0cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.706285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] The token cache is being invalidate because project e88d8d17ff944d149c53bb5200a43976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:48.706653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.707239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-237672d0-87e5-4413-82dc-1211f8ce0cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.708306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:48.712911 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1127/2223] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:48 2022] DELETE /identity/v3/projects/e88d8d17ff944d149c53bb5200a43976 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:48.715915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e610-6be1-448c-b552-0de1c4918ac9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:48.716265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e610-6be1-448c-b552-0de1c4918ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:48.716691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001e610-6be1-448c-b552-0de1c4918ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:48.741250 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6001e610-6be1-448c-b552-0de1c4918ac9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:48.742483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6001e610-6be1-448c-b552-0de1c4918ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:48.806175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:48.807175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:48.807459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:48.807732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] PATH_INFO: `/v3/projects/c087ea49d3c54e7180022c801c5ece4b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:48.808900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c087ea49d3c54e7180022c801c5ece4b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:48.811058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:48.853551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1128/2224] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:48.863320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c15f5-dc41-4909-9485-219181abbcba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:48.864171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c15f5-dc41-4909-9485-219181abbcba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:48.864171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c15f5-dc41-4909-9485-219181abbcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:48.896293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-464c15f5-dc41-4909-9485-219181abbcba None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:48.898789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-464c15f5-dc41-4909-9485-219181abbcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:48.912353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c087ea49d3c54e7180022c801c5ece4b', 'request_id': 'req-1d314459-3563-4efe-90f6-faa76851f431'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.926289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c087ea49d3c54e7180022c801c5ece4b', 'request_id': 'req-1d314459-3563-4efe-90f6-faa76851f431'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.938438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c087ea49d3c54e7180022c801c5ece4b', 'request_id': 'req-1d314459-3563-4efe-90f6-faa76851f431'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.968568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] The token cache is being invalidate because project c087ea49d3c54e7180022c801c5ece4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:48.969139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.970163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d314459-3563-4efe-90f6-faa76851f431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:48.972883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1097/2225] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:48 2022] DELETE /identity/v3/projects/c087ea49d3c54e7180022c801c5ece4b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:48.978164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98998a-8b3f-4577-b8ee-2cf2151c3145 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:48.978823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98998a-8b3f-4577-b8ee-2cf2151c3145 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:48.979264 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98998a-8b3f-4577-b8ee-2cf2151c3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:48.991577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1129/2226] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:48.996428 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c15f5-dc41-4909-9485-219181abbcba None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.002658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cb98998a-8b3f-4577-b8ee-2cf2151c3145 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:49.003869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb98998a-8b3f-4577-b8ee-2cf2151c3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:49.013715 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1098/2227] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:49.017058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c15f5-dc41-4909-9485-219181abbcba None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.022164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.022442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a60b-f730-491a-b615-66d6be5ed985 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.022729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a60b-f730-491a-b615-66d6be5ed985 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.022920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.023033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a60b-f730-491a-b615-66d6be5ed985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.023316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.023484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.024647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:49.024647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.026937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.041039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1130/2228] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:17:49.046936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.051467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2332a60b-f730-491a-b615-66d6be5ed985 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:49.052669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2332a60b-f730-491a-b615-66d6be5ed985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:49.058461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20bfec-d109-4318-85b7-9917d0fe6937 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.061619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1099/2229] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:49.063390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.063998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.064278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.064576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.065240 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.066030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a60b-f730-491a-b615-66d6be5ed985 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.067370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.075903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a60b-f730-491a-b615-66d6be5ed985 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.083704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.084326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.084604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.084875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.085563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:49.085865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.087452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.100814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1100/2230] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:17:49.105337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.111019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1131/2231] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:17:49.112290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.124780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1b985-3b3d-4e6b-ba33-c9674bace035 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.126177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:49.179572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019e959-a2a4-4278-9750-753334882cf1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.184513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.184735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.185158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.185500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.185637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.185799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.185906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.186173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.186500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.186902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.188806 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.189189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.210499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:49.212336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1132/2232] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:49.216341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.225370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1101/2233] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:49.226675 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.227588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd5e4-77e4-41bd-8683-52ef2fca124f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.284540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.285178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.285460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.285733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.286375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.287341 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f336c9-4c2f-4653-af64-dd141af9e06f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.287978 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.292106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.292699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.293070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.293343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.293966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.295883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.297759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1133/2234] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:49.301771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.311738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25222e-8e7d-4b3e-85ee-a8d6981273e1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.316275 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.316860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.317167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.317438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.317579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1102/2235] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:49.318148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.319831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.321931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.334286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1134/2236] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:49.334481 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b144c2-9857-4ad0-8eeb-b38fa3925761 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.335254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.337083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.337670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.337945 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.338212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.338842 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.340419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.345320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52585bdd-7652-4be1-a905-3638bed3e76b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.350370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.351039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.351152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1103/2237] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:49.351320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.351582 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] PATH_INFO: `/v3/projects/5be1f8a503574e6d9131a17090c82d31/users/857f250840c5454a8b0031a5288fe4d3/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.354972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.364321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa84a9c-0511-4fe9-a424-e2555309ff92 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.366701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be1f8a503574e6d9131a17090c82d31, user_id=857f250840c5454a8b0031a5288fe4d3, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.369415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.369579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc60c3-4874-4823-96fe-33ed603e1054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.370151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc60c3-4874-4823-96fe-33ed603e1054 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.370427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc60c3-4874-4823-96fe-33ed603e1054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.370696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc60c3-4874-4823-96fe-33ed603e1054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.371495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc60c3-4874-4823-96fe-33ed603e1054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.373086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc60c3-4874-4823-96fe-33ed603e1054 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.382352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1135/2238] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:49 2022] PUT /identity/v3/projects/5be1f8a503574e6d9131a17090c82d31/users/857f250840c5454a8b0031a5288fe4d3/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:49.392017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1104/2239] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:49.392151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.393514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f822-fa4f-4ce5-8e01-c551b3dc3f99 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.393868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f822-fa4f-4ce5-8e01-c551b3dc3f99 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.394147 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f822-fa4f-4ce5-8e01-c551b3dc3f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.423004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1586f822-fa4f-4ce5-8e01-c551b3dc3f99 None None] MFA Rules not processed for user `857f250840c5454a8b0031a5288fe4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:49.424982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1586f822-fa4f-4ce5-8e01-c551b3dc3f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:49.459112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaa835-4d46-4b9e-9a36-27e81696ee53 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.465165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b77f5-112f-4b92-b94d-f62e147848a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.465915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b77f5-112f-4b92-b94d-f62e147848a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.466195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b77f5-112f-4b92-b94d-f62e147848a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.466733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b77f5-112f-4b92-b94d-f62e147848a0 admin admin] PATH_INFO: `/v3/projects/5f14fe660d6e4d9a921c342de112b5c3/users/bc63a9851c044f01aa3dca5e75158907/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.472207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:49.488459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b77f5-112f-4b92-b94d-f62e147848a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f14fe660d6e4d9a921c342de112b5c3, user_id=bc63a9851c044f01aa3dca5e75158907, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.491127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b77f5-112f-4b92-b94d-f62e147848a0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.508881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1105/2240] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:49.509138 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1136/2241] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:49 2022] PUT /identity/v3/projects/5f14fe660d6e4d9a921c342de112b5c3/users/bc63a9851c044f01aa3dca5e75158907/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:49.510022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586f822-fa4f-4ce5-8e01-c551b3dc3f99 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.521560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.521908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.522032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586f822-fa4f-4ce5-8e01-c551b3dc3f99 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.522296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.551649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] MFA Rules not processed for user `bc63a9851c044f01aa3dca5e75158907`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:49.552872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:49.575638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:49.584636 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.585617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.586057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.586492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.587476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.590167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.625330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1106/2242] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:49.626333 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.636002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1137/2243] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:49.643960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.645941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:49.692302 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746b1dd-408b-42e6-ac47-790ce51acbb2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.697068 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.697957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.697957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.698190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.698800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.700699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.722506 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037b29-46a2-4790-a0a0-399098e06a0a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.723524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1107/2244] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:17:49.727439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.736780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf18b6-e705-4b89-9b84-71eeee59019f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.741756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.742331 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.742609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.742878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.743509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.745099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.756251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1108/2245] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:49.760070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.769954 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3e54-b28d-4f87-902f-43737b9afbc0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.774568 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.775197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.775473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.775742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] PATH_INFO: `/v3/projects/a2a6ec8277a14d7d9c668fb57f9df420/users/1faf5976c5ea4c7386092642416049e1/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.788152 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.789120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.789680 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.790022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.791192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a6ec8277a14d7d9c668fb57f9df420, user_id=1faf5976c5ea4c7386092642416049e1, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.793861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.799022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:49.807502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1109/2246] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:49 2022] PUT /identity/v3/projects/a2a6ec8277a14d7d9c668fb57f9df420/users/1faf5976c5ea4c7386092642416049e1/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:49.811818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.852458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.854434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.865082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1138/2247] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:49.877081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cae95b-9300-4f6e-af6b-19e8e60e10b8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.881732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c686f-5007-4e0d-9d12-5263cdd9721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.882329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c686f-5007-4e0d-9d12-5263cdd9721b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.882600 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c686f-5007-4e0d-9d12-5263cdd9721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.882893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c686f-5007-4e0d-9d12-5263cdd9721b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.883512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c686f-5007-4e0d-9d12-5263cdd9721b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.885121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c686f-5007-4e0d-9d12-5263cdd9721b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.898028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1110/2248] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:49.899161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:49.909228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e858f3b-de56-448d-b504-a2451627857a service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:49.913919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:49.914563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.914840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.915110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] PATH_INFO: `/v3/projects/a2a6ec8277a14d7d9c668fb57f9df420/users/1faf5976c5ea4c7386092642416049e1/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.917001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a6ec8277a14d7d9c668fb57f9df420, user_id=1faf5976c5ea4c7386092642416049e1, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:49.919605 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:49.930322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1139/2249] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:49 2022] PUT /identity/v3/projects/a2a6ec8277a14d7d9c668fb57f9df420/users/1faf5976c5ea4c7386092642416049e1/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:49.941292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:49.941607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:49.941883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:49.970746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] MFA Rules not processed for user `1faf5976c5ea4c7386092642416049e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:49.972003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:49.993220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:50.054458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1111/2250] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:50.068390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:50.070181 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:50.183306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0de7b-13e0-4096-bfc9-ab9dc203349f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:50.188241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:50.189454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:50.189454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:50.189890 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:50.203242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:50.205599 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:50.220343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1140/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:50.315761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:50.317260 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:50.330129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b02f9-824c-4676-bcf2-d8fed7bc02ef None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:50.333689 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f746cd6-7505-42da-91a1-3712b3ebef92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:50.334283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746cd6-7505-42da-91a1-3712b3ebef92 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:50.334556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746cd6-7505-42da-91a1-3712b3ebef92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:50.334818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746cd6-7505-42da-91a1-3712b3ebef92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:50.390387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746cd6-7505-42da-91a1-3712b3ebef92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:50.391733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746cd6-7505-42da-91a1-3712b3ebef92 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:50.400630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1112/2252] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:52.586913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:52.675400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86021bd2-b7f4-4e9d-ac5e-5387b7ac4ef0 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:52.680405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:52.681179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:52.681562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:52.681936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] PATH_INFO: `/v3/users/bc63a9851c044f01aa3dca5e75158907` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:52.683551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc63a9851c044f01aa3dca5e75158907)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:52.686765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:52.746999 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:52.754454 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc63a9851c044f01aa3dca5e75158907'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:52.762519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc63a9851c044f01aa3dca5e75158907'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:52.763172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc63a9851c044f01aa3dca5e75158907'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:52.763818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc63a9851c044f01aa3dca5e75158907'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:52.775678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc63a9851c044f01aa3dca5e75158907'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:52.792320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1141/2253] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:52 2022] DELETE /identity/v3/users/bc63a9851c044f01aa3dca5e75158907 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:52.797313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:52.797807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:52.797920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:52.816669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:52.817908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:52.879120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1113/2254] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:52.889166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:52.890632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:52.946433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02b37-2343-42fb-8b4d-d3c1ca488600 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:52.950092 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:52.950678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:52.950953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:52.951265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:52.960080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:52.961591 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:52.970957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1142/2255] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:53.160058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.161570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.174651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1f31-5b61-479f-8d36-2ba893b7a8e1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.179412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.180144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.180423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.180807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] PATH_INFO: `/v3/users/857f250840c5454a8b0031a5288fe4d3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.182148 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857f250840c5454a8b0031a5288fe4d3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.184115 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.235028 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857f250840c5454a8b0031a5288fe4d3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.236062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857f250840c5454a8b0031a5288fe4d3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.239863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:53.243908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857f250840c5454a8b0031a5288fe4d3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.245166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857f250840c5454a8b0031a5288fe4d3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.252534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.254049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.261672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-727dfd71-1994-4a4a-92a4-e416f30a8f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857f250840c5454a8b0031a5288fe4d3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.274738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1114/2256] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:53 2022] DELETE /identity/v3/users/857f250840c5454a8b0031a5288fe4d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:53.276677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12612b-527a-4e20-b837-643ddde53126 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.278937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.279903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.280179 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.300188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:53.301480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.334751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.335389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.335668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.335944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] PATH_INFO: `/v3/projects/5f14fe660d6e4d9a921c342de112b5c3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.337259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f14fe660d6e4d9a921c342de112b5c3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.339164 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.363271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1115/2257] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:53.374258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.375885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.388172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f14fe660d6e4d9a921c342de112b5c3', 'request_id': 'req-b7786271-9fda-433e-ac2a-e970092a29af'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.397681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f14fe660d6e4d9a921c342de112b5c3', 'request_id': 'req-b7786271-9fda-433e-ac2a-e970092a29af'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.402993 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:53.404553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f14fe660d6e4d9a921c342de112b5c3', 'request_id': 'req-b7786271-9fda-433e-ac2a-e970092a29af'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.418223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] The token cache is being invalidate because project 5f14fe660d6e4d9a921c342de112b5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:53.418512 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.419202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b7786271-9fda-433e-ac2a-e970092a29af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:53.420748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1143/2258] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:53 2022] DELETE /identity/v3/projects/5f14fe660d6e4d9a921c342de112b5c3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:53.425511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8404-3a35-48e9-bcca-601f44906f42 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.425787 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8404-3a35-48e9-bcca-601f44906f42 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.426041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8404-3a35-48e9-bcca-601f44906f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.434511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61badfc-8038-4615-8f2d-08fc579450a9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.445804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6a5a8404-3a35-48e9-bcca-601f44906f42 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:53.447004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a5a8404-3a35-48e9-bcca-601f44906f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.484875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.485516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.485792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.486525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.488335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.507041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1144/2259] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:53.515364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e8b0-a8f9-4677-b1c1-ae187998f896 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.515664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e8b0-a8f9-4677-b1c1-ae187998f896 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.515941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e8b0-a8f9-4677-b1c1-ae187998f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.531690 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:53.535481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4766e8b0-a8f9-4677-b1c1-ae187998f896 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:53.536682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4766e8b0-a8f9-4677-b1c1-ae187998f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.545207 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1145/2260] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:53.549447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e8b0-a8f9-4677-b1c1-ae187998f896 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.558460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e8b0-a8f9-4677-b1c1-ae187998f896 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.558608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.559971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.563693 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.564284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.564563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.564838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.566144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:53.566465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.568053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.570422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1116/2261] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:17:53.580071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1146/2262] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:17:53.584446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.594719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701b5f-8e63-41d1-94c6-9c165e91da4c service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.599623 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.600225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.600503 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.600772 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.601432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.603342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.631585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1117/2263] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:53 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:53.636124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.646862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939358f-fb08-44e9-9f71-acfb50df2972 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.714342 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.714988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.715274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.715553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.716219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.719334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.774135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1147/2264] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:53 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:53.778375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.793504 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899454-ea33-4d70-9c4d-400715a71c11 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.800750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.801497 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.801857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.802180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.802894 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.804959 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.822348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1118/2265] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:53.827119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.842509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1549567-08c6-4dfe-937e-6ce234c653e5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.850768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.851527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.851922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.852340 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.853129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.855619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.873940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1148/2266] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:53.875090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.887191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37aa39-26cd-43b3-873c-691900e10a3f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.895379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1993a7-0d30-4d0a-ad18-c440721a4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.896129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1993a7-0d30-4d0a-ad18-c440721a4c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.896409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1993a7-0d30-4d0a-ad18-c440721a4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.896757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1993a7-0d30-4d0a-ad18-c440721a4c1b admin admin] PATH_INFO: `/v3/projects/56be3616ac0c48bdb3ac915d12540136/users/a18c8f10ca98409db96d2608146ad4a8/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.916612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:53.918822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:53.924379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1993a7-0d30-4d0a-ad18-c440721a4c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56be3616ac0c48bdb3ac915d12540136, user_id=a18c8f10ca98409db96d2608146ad4a8, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.941374 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1993a7-0d30-4d0a-ad18-c440721a4c1b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.941909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675daf13-ebe8-422c-8c3b-dd73f94b1a9c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:53.950717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:53.953022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.953022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.953256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] PATH_INFO: `/v3/projects/5be1f8a503574e6d9131a17090c82d31` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.955028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be1f8a503574e6d9131a17090c82d31)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:53.957374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:53.963938 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1119/2267] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:53 2022] PUT /identity/v3/projects/56be3616ac0c48bdb3ac915d12540136/users/a18c8f10ca98409db96d2608146ad4a8/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:53.977223 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.977639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.978012 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.031553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] MFA Rules not processed for user `a18c8f10ca98409db96d2608146ad4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:54.032779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.035059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:54.044182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be1f8a503574e6d9131a17090c82d31', 'request_id': 'req-5798e3aa-f58a-4c64-8ec0-a06f67af8520'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.059183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be1f8a503574e6d9131a17090c82d31', 'request_id': 'req-5798e3aa-f58a-4c64-8ec0-a06f67af8520'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.070260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be1f8a503574e6d9131a17090c82d31', 'request_id': 'req-5798e3aa-f58a-4c64-8ec0-a06f67af8520'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.086102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] The token cache is being invalidate because project 5be1f8a503574e6d9131a17090c82d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:54.086664 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.087585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.090364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1149/2268] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:53 2022] DELETE /identity/v3/projects/5be1f8a503574e6d9131a17090c82d31 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:54.094579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:54.096314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.122461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1120/2269] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:54.135239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:54.145005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.177231 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798e3aa-f58a-4c64-8ec0-a06f67af8520 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:54.183066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:54.183792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:54.184151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:54.184685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] PATH_INFO: `/v3/users/1faf5976c5ea4c7386092642416049e1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.186353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1faf5976c5ea4c7386092642416049e1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:54.188710 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:54.257351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1faf5976c5ea4c7386092642416049e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.261118 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435307e0-59b4-46b4-9741-58e9f2db6022 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:54.266862 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1faf5976c5ea4c7386092642416049e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.267435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1faf5976c5ea4c7386092642416049e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.267742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fb635cda454c4a89badd09b8396ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:54.268453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:54.268791 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1faf5976c5ea4c7386092642416049e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.269050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:54.269423 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.272420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.280736 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:54.282774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-99bc3669-65ea-4175-a200-371a578408c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1faf5976c5ea4c7386092642416049e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.291015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:54.292848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:54.304022 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1121/2270] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:17:54.326183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1150/2271] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:54 2022] DELETE /identity/v3/users/1faf5976c5ea4c7386092642416049e1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:54.565265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:54.566588 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.580201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30c996-0a91-4023-a2df-fd0355137fe3 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:54.640271 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:54.640900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:54.641204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:54.641608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] PATH_INFO: `/v3/users/a18c8f10ca98409db96d2608146ad4a8` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.642594 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18c8f10ca98409db96d2608146ad4a8)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:54.644596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:54.695131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18c8f10ca98409db96d2608146ad4a8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.695775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18c8f10ca98409db96d2608146ad4a8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.705070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18c8f10ca98409db96d2608146ad4a8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.705900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18c8f10ca98409db96d2608146ad4a8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.719728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18c8f10ca98409db96d2608146ad4a8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.732943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1122/2272] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:54 2022] DELETE /identity/v3/users/a18c8f10ca98409db96d2608146ad4a8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:54.737511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:54.738045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:54.738165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.759232 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:54.760439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.809556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:54.831607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1151/2273] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:54.838857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:54.840720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.868686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:54.870148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.882280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7855ce-df23-41f0-80c7-8f8cc4ec8802 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:54.888132 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:54.888945 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:54.889266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:54.889537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] PATH_INFO: `/v3/projects/a2a6ec8277a14d7d9c668fb57f9df420` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.890706 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a6ec8277a14d7d9c668fb57f9df420)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:54.892636 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:54.922214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c87a9-465d-46c2-9a29-e944285baecf admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:54.926496 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0faba-da16-41d1-8806-487ad7186a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:54.927432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0faba-da16-41d1-8806-487ad7186a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:54.927731 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0faba-da16-41d1-8806-487ad7186a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:54.928104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0faba-da16-41d1-8806-487ad7186a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.941832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0faba-da16-41d1-8806-487ad7186a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:54.943410 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0faba-da16-41d1-8806-487ad7186a77 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:54.954919 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1123/2274] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:54.965695 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a6ec8277a14d7d9c668fb57f9df420', 'request_id': 'req-a9dc5b88-7188-4d19-b8d7-590e0c601542'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.977059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a6ec8277a14d7d9c668fb57f9df420', 'request_id': 'req-a9dc5b88-7188-4d19-b8d7-590e0c601542'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.984433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a6ec8277a14d7d9c668fb57f9df420', 'request_id': 'req-a9dc5b88-7188-4d19-b8d7-590e0c601542'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.996150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] The token cache is being invalidate because project a2a6ec8277a14d7d9c668fb57f9df420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:54.996437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:54.997382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a9dc5b88-7188-4d19-b8d7-590e0c601542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:55.005098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1152/2275] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:54 2022] DELETE /identity/v3/projects/a2a6ec8277a14d7d9c668fb57f9df420 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:55.010556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef27b5-eafc-4ad0-b478-3f9dcc0b86e6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.010924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef27b5-eafc-4ad0-b478-3f9dcc0b86e6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.011350 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef27b5-eafc-4ad0-b478-3f9dcc0b86e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.049561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1fef27b5-eafc-4ad0-b478-3f9dcc0b86e6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:55.051044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1fef27b5-eafc-4ad0-b478-3f9dcc0b86e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:55.061776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:55.142567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1124/2276] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:55.150366 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275fcc4-ad15-4b65-bada-3f084df3c9c6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.150650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275fcc4-ad15-4b65-bada-3f084df3c9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.150942 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275fcc4-ad15-4b65-bada-3f084df3c9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.176059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2275fcc4-ad15-4b65-bada-3f084df3c9c6 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:55.177602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2275fcc4-ad15-4b65-bada-3f084df3c9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:55.190883 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1153/2277] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:55.192771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef27b5-eafc-4ad0-b478-3f9dcc0b86e6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.205390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef27b5-eafc-4ad0-b478-3f9dcc0b86e6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.210660 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.211345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.212052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.212388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.213145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:55.213513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.215187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.229966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1125/2278] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:17:55.234098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275fcc4-ad15-4b65-bada-3f084df3c9c6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.243395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275fcc4-ad15-4b65-bada-3f084df3c9c6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.248393 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.249292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.249465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.249733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.250369 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.252260 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.285814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1154/2279] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:55.289769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.301904 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1419806-768d-43a5-acdb-498930966cd0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.324255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.326782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:55.372545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.373468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.373911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.374186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.374822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.376830 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.402460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e0ef8-8e86-470b-9590-5a55c0d806a9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.407013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1126/2280] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:55.407860 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.408037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.408498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.408779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.409093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] PATH_INFO: `/v3/projects/56be3616ac0c48bdb3ac915d12540136` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.410228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56be3616ac0c48bdb3ac915d12540136)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.412157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.417655 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca9b2c-b8dd-4e82-b9c0-05c461256335 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.423238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.423833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.424114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.424388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.425063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.426697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.441121 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1127/2281] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:55.445175 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.456328 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cd505-dad4-4eba-8c6f-7d3a793443a4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.464996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56be3616ac0c48bdb3ac915d12540136', 'request_id': 'req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:55.467775 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:55.475224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56be3616ac0c48bdb3ac915d12540136', 'request_id': 'req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:55.481843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56be3616ac0c48bdb3ac915d12540136', 'request_id': 'req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:55.493956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] The token cache is being invalidate because project 56be3616ac0c48bdb3ac915d12540136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:55.494316 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:55.495116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6f8e0f7-9cf0-49b0-a4e8-5518cba8dfc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:55.496644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1155/2282] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:55 2022] DELETE /identity/v3/projects/56be3616ac0c48bdb3ac915d12540136 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:55.502631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386297a1-359c-4bb2-bf03-5653394ca0e0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.502912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386297a1-359c-4bb2-bf03-5653394ca0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.503233 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386297a1-359c-4bb2-bf03-5653394ca0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.524213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-386297a1-359c-4bb2-bf03-5653394ca0e0 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:55.524415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.525051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.525338 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.525619 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-386297a1-359c-4bb2-bf03-5653394ca0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:55.525746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.526359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.527971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.541647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1156/2283] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:55.544180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee8d0e-45bf-4a44-989a-4865332d5c47 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.544463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee8d0e-45bf-4a44-989a-4865332d5c47 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.544936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee8d0e-45bf-4a44-989a-4865332d5c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.546324 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1128/2284] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:55.550354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.552072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:55.566097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb495d11-c42e-46cf-9f3e-6fd3230406fb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.568064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f8ee8d0e-45bf-4a44-989a-4865332d5c47 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:55.570076 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f8ee8d0e-45bf-4a44-989a-4865332d5c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:55.571680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386bfea-bb2d-47b0-89d3-f05ada9a52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.572336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386bfea-bb2d-47b0-89d3-f05ada9a52f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.572621 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386bfea-bb2d-47b0-89d3-f05ada9a52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.573089 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386bfea-bb2d-47b0-89d3-f05ada9a52f6 admin admin] PATH_INFO: `/v3/projects/61a3f1e7af5a4fb892ba3fc03af55656/users/26767268b4c940d191b2cfaa078c2881/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.579730 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1157/2285] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:55.584068 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee8d0e-45bf-4a44-989a-4865332d5c47 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.594438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386bfea-bb2d-47b0-89d3-f05ada9a52f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a3f1e7af5a4fb892ba3fc03af55656, user_id=26767268b4c940d191b2cfaa078c2881, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.596402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee8d0e-45bf-4a44-989a-4865332d5c47 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.597152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386bfea-bb2d-47b0-89d3-f05ada9a52f6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.599639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:55.601343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.601941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.602299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.602705 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.603355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:55.603782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.605327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.613750 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1129/2286] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:55 2022] PUT /identity/v3/projects/61a3f1e7af5a4fb892ba3fc03af55656/users/26767268b4c940d191b2cfaa078c2881/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:55.620229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1158/2287] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:17:55.624234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29903b0d-afd1-4120-8353-f2df70be4686 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.624518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29903b0d-afd1-4120-8353-f2df70be4686 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.624790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29903b0d-afd1-4120-8353-f2df70be4686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.624907 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.634665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90623-2804-4545-b242-b781a619ff02 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.653557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-29903b0d-afd1-4120-8353-f2df70be4686 None None] MFA Rules not processed for user `26767268b4c940d191b2cfaa078c2881`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:55.655284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-29903b0d-afd1-4120-8353-f2df70be4686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:55.691118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.691733 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.692122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.692397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.693042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.695024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.721999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1130/2288] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:55.726742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29903b0d-afd1-4120-8353-f2df70be4686 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.729035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1159/2289] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:17:55.729874 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.738292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29903b0d-afd1-4120-8353-f2df70be4686 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.790413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90ea1d-7052-42f0-bbc5-d72012a2f259 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.795026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.795173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.795651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.795784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.795928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.796035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.796197 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.796293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.796814 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.796934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.798728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.798869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.820807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1160/2290] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:55.824900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.828820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1131/2291] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:17:55.832272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.835708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0e798-20b5-40d1-8350-12df7da42d8b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.863001 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:55.910558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.910854 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82726497-38e8-4786-85af-063d116c9a38 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.911710 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.912174 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.912645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.913423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.915834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.916297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.916900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.917201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.917468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.918101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.920515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.927265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1161/2292] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:55.931676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.939242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:55.942889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1e5da-561b-4e68-a9b6-09560209d3d4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.950790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f7884-a3d5-40e5-8b33-0bec0cc8cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.951633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7884-a3d5-40e5-8b33-0bec0cc8cddb admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.952020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7884-a3d5-40e5-8b33-0bec0cc8cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.952302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7884-a3d5-40e5-8b33-0bec0cc8cddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.952950 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f7884-a3d5-40e5-8b33-0bec0cc8cddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.954562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f7884-a3d5-40e5-8b33-0bec0cc8cddb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:55.957344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1132/2293] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:17:55.960311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:55.971868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1162/2294] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:55.973481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50391fae-161e-4c43-9ce6-9a29b1195ada None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.973914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50391fae-161e-4c43-9ce6-9a29b1195ada None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.974200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50391fae-161e-4c43-9ce6-9a29b1195ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.978886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf124c-bd59-4fff-bdb3-414ea374ebd4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:55.984910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:55.985778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:55.986172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:55.986596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:55.987446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:55.989362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.001896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1133/2295] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:56.002802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-50391fae-161e-4c43-9ce6-9a29b1195ada None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:56.004191 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50391fae-161e-4c43-9ce6-9a29b1195ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:56.005790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.015676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55306a42-ddc9-4f32-ba2d-c2c5d3c53064 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.020515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.021212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.021495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.021758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] PATH_INFO: `/v3/projects/8363f9124e3c42c2807fac5b741349be/users/3c7ffc5222b34a1695102a33c2d762f8/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.037216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8363f9124e3c42c2807fac5b741349be, user_id=3c7ffc5222b34a1695102a33c2d762f8, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.039957 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.055149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1134/2296] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:56 2022] PUT /identity/v3/projects/8363f9124e3c42c2807fac5b741349be/users/3c7ffc5222b34a1695102a33c2d762f8/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:56.061064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1163/2297] 10.222.0.25 () {58 vars in 967 bytes} [Sun Oct 23 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:56.066981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.067267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.067542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.069199 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.097533 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] MFA Rules not processed for user `3c7ffc5222b34a1695102a33c2d762f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:56.098741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:56.135980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab82cf1-91c1-403a-8549-6c0563972d8b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.141539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.142201 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.142516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.142785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] PATH_INFO: `/v3/projects/2867276923634a22be670f63462f11d8/users/fac9c9044e434e6da5009d37fd3c1a56/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.157678 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2867276923634a22be670f63462f11d8, user_id=fac9c9044e434e6da5009d37fd3c1a56, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.160307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.168933 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1164/2298] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:56.169841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.171140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:56.174319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1135/2299] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:56 2022] PUT /identity/v3/projects/2867276923634a22be670f63462f11d8/users/fac9c9044e434e6da5009d37fd3c1a56/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:56.175150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.220961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:56.239375 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4460f-975b-48fe-b939-d65e7a1081f1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.242384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d124c-0b9b-4ea7-b13c-22d5a0a1bd4b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.243991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.244590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.244863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.245164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.245839 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.247781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.279659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1136/2300] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:56 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:56.279659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.318022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.318879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.319125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.319434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.327500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:56.368257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ca11-d38d-4098-8c49-4757833f3218 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.385386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.386101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.386542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.387555 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.388220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.390965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.400331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.402177 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.409437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1137/2301] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:56.421032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.421616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1165/2302] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:17:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:56.421616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.439579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffa51-60f3-4b96-9e15-853d89aa1f81 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.440628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899b0bf-e3bf-45f6-ac20-ac01866742a5 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.446009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f22ab-7278-4243-85b2-c2c76b82867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.446303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f22ab-7278-4243-85b2-c2c76b82867a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.446561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.446689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f22ab-7278-4243-85b2-c2c76b82867a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.446853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f22ab-7278-4243-85b2-c2c76b82867a admin admin] PATH_INFO: `/v3/projects/2867276923634a22be670f63462f11d8/users/fac9c9044e434e6da5009d37fd3c1a56/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.447613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.447893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.448161 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.448915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.450165 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f22ab-7278-4243-85b2-c2c76b82867a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2867276923634a22be670f63462f11d8, user_id=fac9c9044e434e6da5009d37fd3c1a56, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.450728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.453110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f22ab-7278-4243-85b2-c2c76b82867a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.477402 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1166/2303] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:56 2022] PUT /identity/v3/projects/2867276923634a22be670f63462f11d8/users/fac9c9044e434e6da5009d37fd3c1a56/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:56.480722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.481043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.481483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.493026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1138/2304] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:56 2022] POST /identity/v3/users => generated 299 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:56.501390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.514122 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced0ad-c938-4fcf-893d-fd65307067f0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.536082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] MFA Rules not processed for user `fac9c9044e434e6da5009d37fd3c1a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:56.538421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:56.611907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.612395 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.612671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.612937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.613617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.615232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.625644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1139/2305] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:56.629861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.635711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1167/2306] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:56.646060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b23ed-2804-4ee9-ad7f-182d33fc6b16 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.647611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.649221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:56.651217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.651873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.653114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.653411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] PATH_INFO: `/v3/projects/667f03a9827b4979873d08e9b000ae90/users/cf20af88f6764051bcc44139b70b89a1/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.657865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:56.671833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667f03a9827b4979873d08e9b000ae90, user_id=cf20af88f6764051bcc44139b70b89a1, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.674533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.689883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1140/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:56 2022] PUT /identity/v3/projects/667f03a9827b4979873d08e9b000ae90/users/cf20af88f6764051bcc44139b70b89a1/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:56.693822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.722157 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39e458-6c99-4e57-9660-55247cb9b51a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.766561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c646-e263-4f4a-bb8b-5a2d35cb8014 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.771728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.772462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.772852 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.773237 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.773960 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.775643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.781361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.781982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.782722 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.783000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.787168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1141/2308] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:56.791235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.801965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaebfb5-969f-46b5-9475-836135312df2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:56.806696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795529-d16b-4ceb-8599-96be968ad13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:56.807446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795529-d16b-4ceb-8599-96be968ad13d admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.807820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795529-d16b-4ceb-8599-96be968ad13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.808241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795529-d16b-4ceb-8599-96be968ad13d admin admin] PATH_INFO: `/v3/projects/667f03a9827b4979873d08e9b000ae90/users/cf20af88f6764051bcc44139b70b89a1/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.810409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7795529-d16b-4ceb-8599-96be968ad13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=667f03a9827b4979873d08e9b000ae90, user_id=cf20af88f6764051bcc44139b70b89a1, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.813217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7795529-d16b-4ceb-8599-96be968ad13d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.835438 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1142/2309] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:56 2022] PUT /identity/v3/projects/667f03a9827b4979873d08e9b000ae90/users/cf20af88f6764051bcc44139b70b89a1/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:56.837671 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b57e4-e62f-482f-889e-7398ebda4434 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:56.837981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b57e4-e62f-482f-889e-7398ebda4434 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:56.838469 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b57e4-e62f-482f-889e-7398ebda4434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:56.848540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:56.850535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:56.851985 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:56.863194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1168/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:17:56.876159 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9e9b57e4-e62f-482f-889e-7398ebda4434 None None] MFA Rules not processed for user `cf20af88f6764051bcc44139b70b89a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:56.877400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9e9b57e4-e62f-482f-889e-7398ebda4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:56.949303 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1143/2311] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:56.961463 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:56.970777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c5f8d-f6ae-4221-96d4-e7105575e8a0 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:57.028328 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486ca4a-ccd3-439e-880f-54ae806cd1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:57.028943 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ca4a-ccd3-439e-880f-54ae806cd1be service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:57.029313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ca4a-ccd3-439e-880f-54ae806cd1be service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:57.029586 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ca4a-ccd3-439e-880f-54ae806cd1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:57.039360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486ca4a-ccd3-439e-880f-54ae806cd1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:57.040829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486ca4a-ccd3-439e-880f-54ae806cd1be service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:57.050893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1169/2312] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:57.081812 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b57e4-e62f-482f-889e-7398ebda4434 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:57.149932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b57e4-e62f-482f-889e-7398ebda4434 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:57.155549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:57.156261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:57.156488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:57.156766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] PATH_INFO: `/v3/users/3c7ffc5222b34a1695102a33c2d762f8` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:57.157967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7ffc5222b34a1695102a33c2d762f8)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:57.159991 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:57.209714 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7ffc5222b34a1695102a33c2d762f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.210472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7ffc5222b34a1695102a33c2d762f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.219831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7ffc5222b34a1695102a33c2d762f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.220561 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7ffc5222b34a1695102a33c2d762f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.236465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7ffc5222b34a1695102a33c2d762f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.250911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1144/2313] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:57 2022] DELETE /identity/v3/users/3c7ffc5222b34a1695102a33c2d762f8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:57.255475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:57.255757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:57.256031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:57.275634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:57.276817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:57.286785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:57.339556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1170/2314] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:57.349203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:57.350878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:57.362549 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:57.410193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1d84-f651-4bd4-835b-268ad26f4900 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:57.413888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:57.414491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:57.414770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:57.415043 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:57.424507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:57.425951 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:57.436205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1145/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:57.742112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:57.743839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:57.759445 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a303a-6af8-445e-b159-61fd089cb991 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:57.764873 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:57.765957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:57.766396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:57.766813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] PATH_INFO: `/v3/projects/8363f9124e3c42c2807fac5b741349be` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:57.768247 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8363f9124e3c42c2807fac5b741349be)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:57.770480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:57.847123 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8363f9124e3c42c2807fac5b741349be', 'request_id': 'req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.856030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8363f9124e3c42c2807fac5b741349be', 'request_id': 'req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.863053 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8363f9124e3c42c2807fac5b741349be', 'request_id': 'req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.874720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] The token cache is being invalidate because project 8363f9124e3c42c2807fac5b741349be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:57.875009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.875663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:57.877179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1171/2316] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:57 2022] DELETE /identity/v3/projects/8363f9124e3c42c2807fac5b741349be => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:57.881202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:57.892109 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04014194-a9fc-44c1-8a9e-f6319ee219d6 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:57.953751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:57.954604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:57.954604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:57.954604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] PATH_INFO: `/v3/users/cf20af88f6764051bcc44139b70b89a1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:57.955645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf20af88f6764051bcc44139b70b89a1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:57.957585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.007662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf20af88f6764051bcc44139b70b89a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.008880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf20af88f6764051bcc44139b70b89a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.017322 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf20af88f6764051bcc44139b70b89a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.017936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf20af88f6764051bcc44139b70b89a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.032613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8898d0ec-32c8-49f6-8f42-946b9a0328e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf20af88f6764051bcc44139b70b89a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.046004 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1146/2317] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:57 2022] DELETE /identity/v3/users/cf20af88f6764051bcc44139b70b89a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:58.333097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:58.334637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:58.352098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39922f-2a3f-4fb9-9f23-15e493db9b3d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:58.412088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:58.412726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.413026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.413302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] PATH_INFO: `/v3/projects/667f03a9827b4979873d08e9b000ae90` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.414407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667f03a9827b4979873d08e9b000ae90)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:58.416297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.457919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:58.465225 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667f03a9827b4979873d08e9b000ae90', 'request_id': 'req-d7d25c01-b690-4698-9af9-d71cb19c9f29'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.472746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667f03a9827b4979873d08e9b000ae90', 'request_id': 'req-d7d25c01-b690-4698-9af9-d71cb19c9f29'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.478932 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667f03a9827b4979873d08e9b000ae90', 'request_id': 'req-d7d25c01-b690-4698-9af9-d71cb19c9f29'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.491937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] The token cache is being invalidate because project 667f03a9827b4979873d08e9b000ae90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:58.492341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.493049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d7d25c01-b690-4698-9af9-d71cb19c9f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:58.494792 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1172/2318] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:58 2022] DELETE /identity/v3/projects/667f03a9827b4979873d08e9b000ae90 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:58.499966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5105ec-6b00-414c-b5be-0237de9324d2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.500259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5105ec-6b00-414c-b5be-0237de9324d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.500550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5105ec-6b00-414c-b5be-0237de9324d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.520456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9c5105ec-6b00-414c-b5be-0237de9324d2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:58.521726 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9c5105ec-6b00-414c-b5be-0237de9324d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:58.548886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:58.588216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1147/2319] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:58.597893 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26345-918a-4430-8037-2019259d6814 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.598190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26345-918a-4430-8037-2019259d6814 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.598471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26345-918a-4430-8037-2019259d6814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.625490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-83e26345-918a-4430-8037-2019259d6814 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:58.627373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-83e26345-918a-4430-8037-2019259d6814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:58.639601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1173/2320] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:58.644071 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5105ec-6b00-414c-b5be-0237de9324d2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:58.667883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5105ec-6b00-414c-b5be-0237de9324d2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:58.672810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:58.673468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.673745 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.674016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.674663 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:58.674965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:58.676545 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.689318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1148/2321] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:17:58.693828 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26345-918a-4430-8037-2019259d6814 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:58.703819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26345-918a-4430-8037-2019259d6814 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:58.708581 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:58.709208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.709490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.709763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.710385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:58.712284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.738716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1174/2322] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:58 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:17:58.742907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:58.753355 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a32a-3582-41e0-9ba6-2a2539eb5c36 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:58.808782 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:58.809420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.809702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.809971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.811087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:58.812995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.834037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1149/2323] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:58 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:58.838252 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:58.848377 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9315c3-cdbb-4286-b19a-76b7e808a015 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:58.853280 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:58.853819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.854096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.854367 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.855411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:58.858867 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.871995 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1175/2324] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:58.876444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:58.886620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da82d5-0024-4968-b483-03778fc2dbf3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:58.891312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff246188-2aad-47ec-872d-f92b153129cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:58.891935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff246188-2aad-47ec-872d-f92b153129cb admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.892216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff246188-2aad-47ec-872d-f92b153129cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.892491 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff246188-2aad-47ec-872d-f92b153129cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.893176 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff246188-2aad-47ec-872d-f92b153129cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:58.894801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff246188-2aad-47ec-872d-f92b153129cb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.905311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1150/2325] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:58.909329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:58.919126 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213afe6-7450-4aa7-8f4e-422265ad50e2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:58.924199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:58.924837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.925151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.925421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] PATH_INFO: `/v3/projects/474fbd1d67cc4385bcfd9b0185d226ff/users/e6088d08054740ac91fd5c8e60dc98df/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.940155 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474fbd1d67cc4385bcfd9b0185d226ff, user_id=e6088d08054740ac91fd5c8e60dc98df, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:58.942842 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:58.956832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1176/2326] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:58 2022] PUT /identity/v3/projects/474fbd1d67cc4385bcfd9b0185d226ff/users/e6088d08054740ac91fd5c8e60dc98df/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:58.967205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12fcf4-da52-4c06-b1be-f338cdeda5ed None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:58.967796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12fcf4-da52-4c06-b1be-f338cdeda5ed None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:58.967796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12fcf4-da52-4c06-b1be-f338cdeda5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:58.995280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0e12fcf4-da52-4c06-b1be-f338cdeda5ed None None] MFA Rules not processed for user `e6088d08054740ac91fd5c8e60dc98df`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:58.996479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e12fcf4-da52-4c06-b1be-f338cdeda5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:59.058653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1151/2327] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:59.063831 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.126478 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a6ced-5172-4de4-80c0-24e2b0690ff6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.131617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bdf63-4e76-4557-af5d-628941392330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.132259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bdf63-4e76-4557-af5d-628941392330 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.132545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bdf63-4e76-4557-af5d-628941392330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.132829 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bdf63-4e76-4557-af5d-628941392330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.133508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bdf63-4e76-4557-af5d-628941392330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.135472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bdf63-4e76-4557-af5d-628941392330 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.163397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1177/2328] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:59 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:59.168926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12fcf4-da52-4c06-b1be-f338cdeda5ed None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.181191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12fcf4-da52-4c06-b1be-f338cdeda5ed None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.189097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01669-d617-49f4-a7a9-2e0dd445aee1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.189410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01669-d617-49f4-a7a9-2e0dd445aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.189682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01669-d617-49f4-a7a9-2e0dd445aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.209021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:59.209756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-39f01669-d617-49f4-a7a9-2e0dd445aee1 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:59.211484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-39f01669-d617-49f4-a7a9-2e0dd445aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:59.245626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.246277 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.247091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.247536 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.249146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.251278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.261195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:59.273527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1178/2329] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:17:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:59.276966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1152/2330] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:59 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:59.278117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01669-d617-49f4-a7a9-2e0dd445aee1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.287127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.288925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:59.291443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01669-d617-49f4-a7a9-2e0dd445aee1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.296761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.297405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.297676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.297944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.298587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.300408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.313485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1179/2331] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:59.317323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.327598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67252865-3237-40d7-b01d-0fe6ac21053a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.332124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.332756 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.333062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.333338 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] PATH_INFO: `/v3/projects/b6c3595a1d1a47ddaee35d4e26e6282b/users/decf7a5cc60b4a33a0371f4627418620/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.348631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c3595a1d1a47ddaee35d4e26e6282b, user_id=decf7a5cc60b4a33a0371f4627418620, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.351620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.361704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf4c1-dc4b-409b-b06b-26c5b779680e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.365851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1180/2332] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:59 2022] PUT /identity/v3/projects/b6c3595a1d1a47ddaee35d4e26e6282b/users/decf7a5cc60b4a33a0371f4627418620/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:59.369735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.423188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.423803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.424079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.424605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.436108 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d532d1-2e4d-4059-b24c-52ac5ce14819 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.441112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.441726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.442011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.442291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.442935 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.444553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.457029 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1181/2333] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:17:59.458751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.468645 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27af291-980b-4efc-9ef8-4b5194c0673c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.479269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa93e4-2ef5-4e36-a314-235c07484c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.479947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa93e4-2ef5-4e36-a314-235c07484c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.480345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa93e4-2ef5-4e36-a314-235c07484c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.480632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa93e4-2ef5-4e36-a314-235c07484c69 admin admin] PATH_INFO: `/v3/projects/b6c3595a1d1a47ddaee35d4e26e6282b/users/decf7a5cc60b4a33a0371f4627418620/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.482666 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa93e4-2ef5-4e36-a314-235c07484c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c3595a1d1a47ddaee35d4e26e6282b, user_id=decf7a5cc60b4a33a0371f4627418620, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.484458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.485407 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa93e4-2ef5-4e36-a314-235c07484c69 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.486064 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.491091 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:59.496964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1182/2334] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:59 2022] PUT /identity/v3/projects/b6c3595a1d1a47ddaee35d4e26e6282b/users/decf7a5cc60b4a33a0371f4627418620/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:17:59.501221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1153/2335] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:17:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 02:17:59.507415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488425f-61d6-45b7-8e8f-b8376ce3ae8f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.507699 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488425f-61d6-45b7-8e8f-b8376ce3ae8f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.507973 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488425f-61d6-45b7-8e8f-b8376ce3ae8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.542633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6488425f-61d6-45b7-8e8f-b8376ce3ae8f None None] MFA Rules not processed for user `decf7a5cc60b4a33a0371f4627418620`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:59.543827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6488425f-61d6-45b7-8e8f-b8376ce3ae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:59.636816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1183/2336] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:17:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:59.650760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:59.652800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:59.763861 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87317e-5daa-4369-9f29-ef46b15c17e9 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:59.862619 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bab4f-b13c-4e4d-8e75-ba22f1b6dd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:59.863337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bab4f-b13c-4e4d-8e75-ba22f1b6dd9d service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:59.863684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bab4f-b13c-4e4d-8e75-ba22f1b6dd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:59.864030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bab4f-b13c-4e4d-8e75-ba22f1b6dd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:59.874825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bab4f-b13c-4e4d-8e75-ba22f1b6dd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:59.876384 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bab4f-b13c-4e4d-8e75-ba22f1b6dd9d service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:59.902362 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1154/2337] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:59.976403 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488425f-61d6-45b7-8e8f-b8376ce3ae8f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:00.027545 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:00.073777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488425f-61d6-45b7-8e8f-b8376ce3ae8f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:00.080419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:00.081424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:00.081819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:00.082266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] PATH_INFO: `/v3/users/e6088d08054740ac91fd5c8e60dc98df` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:00.084035 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6088d08054740ac91fd5c8e60dc98df)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:00.087526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:00.198780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6088d08054740ac91fd5c8e60dc98df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.216096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6088d08054740ac91fd5c8e60dc98df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.217425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6088d08054740ac91fd5c8e60dc98df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.218079 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6088d08054740ac91fd5c8e60dc98df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.234318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6088d08054740ac91fd5c8e60dc98df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.265216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1184/2338] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:59 2022] DELETE /identity/v3/users/e6088d08054740ac91fd5c8e60dc98df => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:00.269983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:00.270511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:00.270511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:00.296570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:00.297837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:00.366653 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1155/2339] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:00.376677 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:00.378144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:00.440030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae25b71-98ff-49c8-ade5-2d86710bf75f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:00.444020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:00.444635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:00.444929 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:00.445221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:00.454843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:00.456263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:00.465583 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1185/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:00.778529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:00.780543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:00.808706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d4a9c-c81d-47a1-9352-9e904defc18d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:00.829765 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:00.830442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:00.830723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:00.831005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] PATH_INFO: `/v3/projects/474fbd1d67cc4385bcfd9b0185d226ff` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:00.832859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474fbd1d67cc4385bcfd9b0185d226ff)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:00.834890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:00.902728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474fbd1d67cc4385bcfd9b0185d226ff', 'request_id': 'req-71ab176a-9561-4d68-b55c-8a4bb7534515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.907044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:00.910359 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474fbd1d67cc4385bcfd9b0185d226ff', 'request_id': 'req-71ab176a-9561-4d68-b55c-8a4bb7534515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.921400 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474fbd1d67cc4385bcfd9b0185d226ff', 'request_id': 'req-71ab176a-9561-4d68-b55c-8a4bb7534515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.936097 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] The token cache is being invalidate because project 474fbd1d67cc4385bcfd9b0185d226ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:00.937411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.938116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:00.939698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1156/2341] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:00 2022] DELETE /identity/v3/projects/474fbd1d67cc4385bcfd9b0185d226ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:00.944285 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:00.955350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ff9cb-8aa3-4be4-83be-fdf632565dbb service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:01.010295 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:01.022135 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:01.022804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:01.023310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:01.023755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] PATH_INFO: `/v3/users/decf7a5cc60b4a33a0371f4627418620` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:01.025217 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decf7a5cc60b4a33a0371f4627418620)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:01.027238 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:01.084485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decf7a5cc60b4a33a0371f4627418620'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.098873 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decf7a5cc60b4a33a0371f4627418620'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.100004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decf7a5cc60b4a33a0371f4627418620'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.101043 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decf7a5cc60b4a33a0371f4627418620'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.129416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decf7a5cc60b4a33a0371f4627418620'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.147535 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1186/2342] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:00 2022] DELETE /identity/v3/users/decf7a5cc60b4a33a0371f4627418620 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:01.409688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:01.411235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:01.511312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab176a-9561-4d68-b55c-8a4bb7534515 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:01.527279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:01.528782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:01.595051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77c4e-f3c9-4aae-91d3-630a64065dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:01.595934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77c4e-f3c9-4aae-91d3-630a64065dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:01.596385 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77c4e-f3c9-4aae-91d3-630a64065dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:01.596659 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77c4e-f3c9-4aae-91d3-630a64065dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:01.599559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-07f77c4e-f3c9-4aae-91d3-630a64065dd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:01.645269 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daf078-983c-479f-aa42-a098dc857016 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:01.651546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:01.652498 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:01.652799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:01.653276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] PATH_INFO: `/v3/projects/b6c3595a1d1a47ddaee35d4e26e6282b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:01.655537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c3595a1d1a47ddaee35d4e26e6282b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:01.658182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:01.679123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f77c4e-f3c9-4aae-91d3-630a64065dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:01.680597 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f77c4e-f3c9-4aae-91d3-630a64065dd4 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:01.691837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1157/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:01.719311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c3595a1d1a47ddaee35d4e26e6282b', 'request_id': 'req-a61b44e3-fba7-42da-a0d1-c8d985117580'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.728105 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c3595a1d1a47ddaee35d4e26e6282b', 'request_id': 'req-a61b44e3-fba7-42da-a0d1-c8d985117580'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.735216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c3595a1d1a47ddaee35d4e26e6282b', 'request_id': 'req-a61b44e3-fba7-42da-a0d1-c8d985117580'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.744916 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:01.750585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] The token cache is being invalidate because project b6c3595a1d1a47ddaee35d4e26e6282b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:01.751271 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.752297 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61b44e3-fba7-42da-a0d1-c8d985117580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:01.754817 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1187/2344] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:01 2022] DELETE /identity/v3/projects/b6c3595a1d1a47ddaee35d4e26e6282b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:01.759856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d617c9-b701-422d-aee2-ca2386b4159d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:01.760129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d617c9-b701-422d-aee2-ca2386b4159d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:01.760402 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d617c9-b701-422d-aee2-ca2386b4159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:01.781321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-41d617c9-b701-422d-aee2-ca2386b4159d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:01.782527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-41d617c9-b701-422d-aee2-ca2386b4159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:01.846209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:01.879860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1158/2345] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:01.882288 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a5e9-2414-4f30-997a-1e2ccb950965 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:01.882872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a5e9-2414-4f30-997a-1e2ccb950965 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:01.883302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a5e9-2414-4f30-997a-1e2ccb950965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:01.912779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a8d9a5e9-2414-4f30-997a-1e2ccb950965 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:01.914909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a8d9a5e9-2414-4f30-997a-1e2ccb950965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:01.934405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1188/2346] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:01.934996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d617c9-b701-422d-aee2-ca2386b4159d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:01.948189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d617c9-b701-422d-aee2-ca2386b4159d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:01.954100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:01.954832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:01.955080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:01.955301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:01.955942 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:01.956251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:01.957902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:01.976390 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1159/2347] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:18:01.977243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a5e9-2414-4f30-997a-1e2ccb950965 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:01.988738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a5e9-2414-4f30-997a-1e2ccb950965 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:01.994099 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:01.994718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:01.994988 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:01.995417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:01.995927 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:01.998648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.039336 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1189/2348] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:01 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:02.043878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.075088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c1f7-cbe8-4c60-926b-308baa846b68 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.191032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.191618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.191883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.192165 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.192902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.195819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.225955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1160/2349] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:02 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:02.227404 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.238689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c03e-3cb6-4abb-806d-526caeaaae87 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.243850 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.244459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.245567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.245567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.245800 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.247258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.259851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1190/2350] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:02.263870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.275578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3eba-b0a8-4c81-afb5-40bcb7973e45 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.284300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eb307-f35b-40c4-b92c-8260807b58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.284835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eb307-f35b-40c4-b92c-8260807b58b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.285168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eb307-f35b-40c4-b92c-8260807b58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.285449 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eb307-f35b-40c4-b92c-8260807b58b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.286101 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eb307-f35b-40c4-b92c-8260807b58b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.287795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eb307-f35b-40c4-b92c-8260807b58b8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.300666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1161/2351] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:02.304570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.314685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f376e0-7a21-4e50-adef-a7e370d5b1d8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.319397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.320055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.320337 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.320610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] PATH_INFO: `/v3/projects/eaed77c1c90c46fead591201002bb511/users/ebc6d95abf074985ae17504305eb0141/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.337957 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaed77c1c90c46fead591201002bb511, user_id=ebc6d95abf074985ae17504305eb0141, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.340649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.367203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1191/2352] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:02 2022] PUT /identity/v3/projects/eaed77c1c90c46fead591201002bb511/users/ebc6d95abf074985ae17504305eb0141/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:02.377641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c79f8-4603-4b58-8f02-c732b75051d0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.377855 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c79f8-4603-4b58-8f02-c732b75051d0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.378174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c79f8-4603-4b58-8f02-c732b75051d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.408799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-248c79f8-4603-4b58-8f02-c732b75051d0 None None] MFA Rules not processed for user `ebc6d95abf074985ae17504305eb0141`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:02.410380 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-248c79f8-4603-4b58-8f02-c732b75051d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:02.474933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1162/2353] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:02.480204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.551826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb71ed7-193f-464c-8272-d1d598878e52 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.556431 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.557074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.557491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.557669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.558241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.560184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.589362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1192/2354] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:02 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:02.593890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c79f8-4603-4b58-8f02-c732b75051d0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.605577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c79f8-4603-4b58-8f02-c732b75051d0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.660391 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:02.680657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.681297 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.681580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.682092 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.682499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.684422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.711191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1163/2355] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:02 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:02.716234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.729632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00582114-77b1-439d-be44-45efb207c60c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.735869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.736686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.737071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.737501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.738172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.740062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.754334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1193/2356] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:02.758532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.770661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a2a9-988a-4251-8e65-8a39e5a3b9bd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.775878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21a51c-d490-41de-a592-88e31bf84250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.776577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21a51c-d490-41de-a592-88e31bf84250 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.776866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21a51c-d490-41de-a592-88e31bf84250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.777191 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21a51c-d490-41de-a592-88e31bf84250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.777905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21a51c-d490-41de-a592-88e31bf84250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.780309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21a51c-d490-41de-a592-88e31bf84250 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.794187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1164/2357] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:02.798863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:02.810395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38adf82-eb26-4e57-9c76-4ebcd6662426 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:02.817601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:02.818364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.818649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.818926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] PATH_INFO: `/v3/projects/e629b76100b1464ca4b96b84a41e303d/users/e8941a54a71f4415997777655bd9cee1/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.840838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e629b76100b1464ca4b96b84a41e303d, user_id=e8941a54a71f4415997777655bd9cee1, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:02.844305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:02.861461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1194/2358] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:02 2022] PUT /identity/v3/projects/e629b76100b1464ca4b96b84a41e303d/users/e8941a54a71f4415997777655bd9cee1/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:02.873317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b593-bed9-4194-b093-44cbd3da74f3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:02.873612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b593-bed9-4194-b093-44cbd3da74f3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:02.873893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b593-bed9-4194-b093-44cbd3da74f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:02.913965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c9e5b593-bed9-4194-b093-44cbd3da74f3 None None] MFA Rules not processed for user `e8941a54a71f4415997777655bd9cee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:02.918473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c9e5b593-bed9-4194-b093-44cbd3da74f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:02.989821 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1165/2359] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:02.994426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:03.057103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:03.080588 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd768b2-f344-4861-b3b2-fd44b38417df admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:03.085437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:03.086799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.086799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.086799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.087908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:03.090490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:03.143106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1195/2360] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:02 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:03.146981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b593-bed9-4194-b093-44cbd3da74f3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:03.160831 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b593-bed9-4194-b093-44cbd3da74f3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:03.241401 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:03.242014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.242279 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.242548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.243195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:03.245231 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:03.275087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1166/2361] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:03 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:03.276303 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:03.290229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d814d-d693-4ab7-aacd-30970ccdfbcf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:03.295596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:03.296258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.296541 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.296819 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.297493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:03.299106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:03.318286 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1196/2362] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:03.326114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:03.344508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afd675-a1b5-4eea-bfe8-40f788428adf admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:03.350481 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:03.352079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.352446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.352734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] PATH_INFO: `/v3/projects/46ec3a5b2b784b059abde9325de42256/users/ddb703b9c4ed41018eeac4985c86b475/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.370254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ec3a5b2b784b059abde9325de42256, user_id=ddb703b9c4ed41018eeac4985c86b475, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:03.374080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:03.393995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1167/2363] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:03 2022] PUT /identity/v3/projects/46ec3a5b2b784b059abde9325de42256/users/ddb703b9c4ed41018eeac4985c86b475/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:03.398090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:03.413166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86545d-e577-459d-a6f5-e9bd95992762 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:03.486618 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efbdf9-3cb0-4b45-807f-a13a1c51cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:03.487401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbdf9-3cb0-4b45-807f-a13a1c51cd18 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.487757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbdf9-3cb0-4b45-807f-a13a1c51cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.488106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbdf9-3cb0-4b45-807f-a13a1c51cd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.488959 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efbdf9-3cb0-4b45-807f-a13a1c51cd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:03.490691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efbdf9-3cb0-4b45-807f-a13a1c51cd18 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:03.506918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1197/2364] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:03.508050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:03.519983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869f41-fe62-4f45-9f02-7f0b181766fe admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:03.526994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:03.527874 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.528321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.528767 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] PATH_INFO: `/v3/projects/46ec3a5b2b784b059abde9325de42256/users/ddb703b9c4ed41018eeac4985c86b475/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.531172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ec3a5b2b784b059abde9325de42256, user_id=ddb703b9c4ed41018eeac4985c86b475, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:03.534465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:03.549182 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1168/2365] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:03 2022] PUT /identity/v3/projects/46ec3a5b2b784b059abde9325de42256/users/ddb703b9c4ed41018eeac4985c86b475/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:03.558064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.558585 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.558940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.595590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] MFA Rules not processed for user `ddb703b9c4ed41018eeac4985c86b475`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:03.596725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:03.672249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1198/2366] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:03.684356 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:03.686363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:03.694476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:03.751460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca355cf-a18e-4de9-9d4f-7a4c2780497b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:03.757558 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:03.758026 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:03.758308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:03.758584 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:03.768228 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:03.769685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:03.780773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1169/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:18:04.402261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:04.403680 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:04.419114 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81042881-cdd3-4e99-a84c-1e507505009f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:04.423494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674dc70-e8de-426b-8335-9a28a10192dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:04.424810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674dc70-e8de-426b-8335-9a28a10192dc service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:04.425251 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674dc70-e8de-426b-8335-9a28a10192dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:04.425528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674dc70-e8de-426b-8335-9a28a10192dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:04.487802 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:04.509241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674dc70-e8de-426b-8335-9a28a10192dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:04.512022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674dc70-e8de-426b-8335-9a28a10192dc service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:04.533312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1199/2368] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:06.958983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:06.960495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:07.034151 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a237d39-7228-4ecd-9dd0-27008760b20b service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:07.038884 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:07.039571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:07.039850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:07.040218 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] PATH_INFO: `/v3/users/26767268b4c940d191b2cfaa078c2881` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:07.041734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26767268b4c940d191b2cfaa078c2881)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:07.043670 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:07.103211 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26767268b4c940d191b2cfaa078c2881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.104038 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26767268b4c940d191b2cfaa078c2881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.116502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26767268b4c940d191b2cfaa078c2881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.117450 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26767268b4c940d191b2cfaa078c2881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.134498 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26767268b4c940d191b2cfaa078c2881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.149035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1170/2369] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:06 2022] DELETE /identity/v3/users/26767268b4c940d191b2cfaa078c2881 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:07.153609 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:07.155000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:07.155430 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:07.176778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:07.178012 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:07.249436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1200/2370] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:07.258761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:07.260293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:07.293479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:07.334947 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb9c1f-37ba-46d7-9db4-c2528abac556 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:07.341116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:07.341116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:07.341116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:07.341116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:07.352923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:07.354832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:07.367352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1171/2371] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:07.706821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:07.708361 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:07.735290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aee97a-b2f5-4152-ad68-634aebdeafd2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:07.748841 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:07.749543 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:07.749813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:07.750084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] PATH_INFO: `/v3/projects/61a3f1e7af5a4fb892ba3fc03af55656` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:07.752266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a3f1e7af5a4fb892ba3fc03af55656)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:07.754359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:07.851746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a3f1e7af5a4fb892ba3fc03af55656', 'request_id': 'req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.862795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a3f1e7af5a4fb892ba3fc03af55656', 'request_id': 'req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.869595 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a3f1e7af5a4fb892ba3fc03af55656', 'request_id': 'req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.881453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] The token cache is being invalidate because project 61a3f1e7af5a4fb892ba3fc03af55656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:07.881749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.882401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:07.883901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1201/2372] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:07 2022] DELETE /identity/v3/projects/61a3f1e7af5a4fb892ba3fc03af55656 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:07.888472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:07.898477 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96922deb-5da3-4528-ad3e-712c143d6d5b service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:07.963850 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:07.964492 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:07.964766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:07.965065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] PATH_INFO: `/v3/users/fac9c9044e434e6da5009d37fd3c1a56` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:07.966827 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac9c9044e434e6da5009d37fd3c1a56)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:07.968769 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:08.017948 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac9c9044e434e6da5009d37fd3c1a56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.018614 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac9c9044e434e6da5009d37fd3c1a56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.027478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac9c9044e434e6da5009d37fd3c1a56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.028305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac9c9044e434e6da5009d37fd3c1a56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.041032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ce93c9a3-bb38-40d1-83ad-2a5ebd22d73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac9c9044e434e6da5009d37fd3c1a56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.052995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1172/2373] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:07 2022] DELETE /identity/v3/users/fac9c9044e434e6da5009d37fd3c1a56 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:08.353414 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:08.355584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:08.383312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d147bf8-d8ca-40c3-aee2-afc2888fb30b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:08.461632 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:08.462405 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:08.462698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:08.462969 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] PATH_INFO: `/v3/projects/2867276923634a22be670f63462f11d8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:08.464113 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2867276923634a22be670f63462f11d8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:08.466102 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:08.475707 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:08.527683 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2867276923634a22be670f63462f11d8', 'request_id': 'req-5b99ce93-7bac-4a73-87dd-9babebc7dc30'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.548917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2867276923634a22be670f63462f11d8', 'request_id': 'req-5b99ce93-7bac-4a73-87dd-9babebc7dc30'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.560992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2867276923634a22be670f63462f11d8', 'request_id': 'req-5b99ce93-7bac-4a73-87dd-9babebc7dc30'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.577494 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] The token cache is being invalidate because project 2867276923634a22be670f63462f11d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:08.577812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.578530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b99ce93-7bac-4a73-87dd-9babebc7dc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:08.580529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1202/2374] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:08 2022] DELETE /identity/v3/projects/2867276923634a22be670f63462f11d8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:08.586461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee7361-6b42-4c44-9a33-f1ffbadd17bb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:08.586891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee7361-6b42-4c44-9a33-f1ffbadd17bb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:08.587361 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee7361-6b42-4c44-9a33-f1ffbadd17bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:08.613164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6fee7361-6b42-4c44-9a33-f1ffbadd17bb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:08.614460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6fee7361-6b42-4c44-9a33-f1ffbadd17bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:08.672036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:08.693011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1173/2375] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:08.698267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41852-f06b-404a-8e0d-72242553bee4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:08.698559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41852-f06b-404a-8e0d-72242553bee4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:08.698845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41852-f06b-404a-8e0d-72242553bee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:08.729520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1df41852-f06b-404a-8e0d-72242553bee4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:08.730746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1df41852-f06b-404a-8e0d-72242553bee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:08.749562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1203/2376] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:08.750900 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee7361-6b42-4c44-9a33-f1ffbadd17bb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:08.761721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee7361-6b42-4c44-9a33-f1ffbadd17bb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:08.768171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:08.768895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:08.769284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:08.769628 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:08.770357 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:08.770732 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:08.772416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:08.789015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1174/2377] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:08.791761 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41852-f06b-404a-8e0d-72242553bee4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:08.802090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41852-f06b-404a-8e0d-72242553bee4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:08.821331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:08.824449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:08.824887 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:08.825315 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:08.826752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:08.829389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:08.889032 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1204/2378] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:08 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:08.893506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:08.908637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932db5-4de9-4e8d-afe9-64ae46ba34b2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:08.992482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:08.993205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:08.993443 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:08.993645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:08.994273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:08.996166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:09.022672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1175/2379] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:08 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:09.030331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:09.048080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620bd5-a330-400a-b4aa-61ee8a39d1fa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:09.053682 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:09.054923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.055380 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.056222 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.056905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:09.059274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:09.075216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1205/2380] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:09.079530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:09.096318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384e737-9ca6-48f1-a3e2-26538524fdf9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:09.101024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:09.102725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:09.109694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:09.109694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.109694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.109694 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.110150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:09.112708 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:09.145155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1176/2381] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:09.157986 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:09.173464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3abb6-85e2-4f7a-b1f4-d73e907aa8ff admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:09.179239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572162b7-7632-4283-b84d-63b7bc4f3d5e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:09.179823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3728af-e3d6-4d6f-91e3-e779883c8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:09.180500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3728af-e3d6-4d6f-91e3-e779883c8d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.180778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3728af-e3d6-4d6f-91e3-e779883c8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.181084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3728af-e3d6-4d6f-91e3-e779883c8d34 admin admin] PATH_INFO: `/v3/projects/6aa215a72d6443cd98601935fdff4e9a/users/e486ecf78e5f46169346f0123eba6df9/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.184204 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:09.185278 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.185961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.186296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.188485 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:09.202857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3728af-e3d6-4d6f-91e3-e779883c8d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa215a72d6443cd98601935fdff4e9a, user_id=e486ecf78e5f46169346f0123eba6df9, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:09.205569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3728af-e3d6-4d6f-91e3-e779883c8d34 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:09.229016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1177/2382] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:09 2022] PUT /identity/v3/projects/6aa215a72d6443cd98601935fdff4e9a/users/e486ecf78e5f46169346f0123eba6df9/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:09.241524 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f0b0-a206-412f-8360-ca68be631a45 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.241811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f0b0-a206-412f-8360-ca68be631a45 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.242089 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f0b0-a206-412f-8360-ca68be631a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.274621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:09.277675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:09.285907 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8633f0b0-a206-412f-8360-ca68be631a45 None None] MFA Rules not processed for user `e486ecf78e5f46169346f0123eba6df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:09.287310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8633f0b0-a206-412f-8360-ca68be631a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:09.289616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1206/2383] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:18:09.364418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1178/2384] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:09.376880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:09.378563 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:09.392334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04683f7-31e3-42fe-ba23-5ba0ff68e749 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:09.398133 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:09.478974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305220c-4d1d-4ded-b147-2abef83947c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:09.480131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305220c-4d1d-4ded-b147-2abef83947c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.481140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305220c-4d1d-4ded-b147-2abef83947c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.481555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305220c-4d1d-4ded-b147-2abef83947c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.496148 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305220c-4d1d-4ded-b147-2abef83947c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:09.497875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305220c-4d1d-4ded-b147-2abef83947c0 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:09.510953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1207/2385] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:09.542643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f0b0-a206-412f-8360-ca68be631a45 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:09.585616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:09.653457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f0b0-a206-412f-8360-ca68be631a45 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:09.658949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:09.659817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.660256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.660689 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] PATH_INFO: `/v3/users/e486ecf78e5f46169346f0123eba6df9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.662203 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e486ecf78e5f46169346f0123eba6df9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:09.664325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:09.739751 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e486ecf78e5f46169346f0123eba6df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:09.740562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e486ecf78e5f46169346f0123eba6df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:09.753212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e486ecf78e5f46169346f0123eba6df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:09.754034 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e486ecf78e5f46169346f0123eba6df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:09.769414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e486ecf78e5f46169346f0123eba6df9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:09.790283 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1179/2386] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:09 2022] DELETE /identity/v3/users/e486ecf78e5f46169346f0123eba6df9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:09.793246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.794071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.794515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:09.818641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:09.820106 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:09.900077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1208/2387] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:09.906994 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:09.908465 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:09.991457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94da02-6ad5-42ee-afdb-259e00f24fb2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:09.995187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fbbf5-daad-46da-a716-b89ecfce029e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:09.995805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fbbf5-daad-46da-a716-b89ecfce029e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:09.996062 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fbbf5-daad-46da-a716-b89ecfce029e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:09.996329 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fbbf5-daad-46da-a716-b89ecfce029e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.006789 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fbbf5-daad-46da-a716-b89ecfce029e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.008154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fbbf5-daad-46da-a716-b89ecfce029e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.020057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1180/2388] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:10.342591 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:10.344051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:10.359574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022323ea-a7f2-4ddf-87d3-c3e5cfbdc939 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:10.378548 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:10.379572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.380216 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.380716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] PATH_INFO: `/v3/projects/6aa215a72d6443cd98601935fdff4e9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.391519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa215a72d6443cd98601935fdff4e9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.393523 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.444059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa215a72d6443cd98601935fdff4e9a', 'request_id': 'req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:10.451903 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa215a72d6443cd98601935fdff4e9a', 'request_id': 'req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:10.459146 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa215a72d6443cd98601935fdff4e9a', 'request_id': 'req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:10.472351 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] The token cache is being invalidate because project 6aa215a72d6443cd98601935fdff4e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:10.472924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:10.474418 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-502ac4ee-bdd0-4d3a-b66f-3fa8e2ffcc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:10.477330 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1209/2389] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:10 2022] DELETE /identity/v3/projects/6aa215a72d6443cd98601935fdff4e9a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:10.482924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13c2b-144b-4609-83d9-faa63b7c013e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.483358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13c2b-144b-4609-83d9-faa63b7c013e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.483642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13c2b-144b-4609-83d9-faa63b7c013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.504835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c6d13c2b-144b-4609-83d9-faa63b7c013e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:10.506192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c6d13c2b-144b-4609-83d9-faa63b7c013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:10.548955 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:10.574363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1181/2390] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:10.583026 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a89f29-3f9b-4a69-bfb4-f6eca3ac83a5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.583615 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a89f29-3f9b-4a69-bfb4-f6eca3ac83a5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.584112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a89f29-3f9b-4a69-bfb4-f6eca3ac83a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.609505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-80a89f29-3f9b-4a69-bfb4-f6eca3ac83a5 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:10.611385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-80a89f29-3f9b-4a69-bfb4-f6eca3ac83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:10.620590 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1210/2391] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:10.625788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13c2b-144b-4609-83d9-faa63b7c013e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:10.636998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13c2b-144b-4609-83d9-faa63b7c013e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:10.642965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:10.643583 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.644548 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.644777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.645645 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:10.646083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.647662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.661639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1182/2392] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:10.665968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a89f29-3f9b-4a69-bfb4-f6eca3ac83a5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:10.675914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a89f29-3f9b-4a69-bfb4-f6eca3ac83a5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:10.681210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:10.681833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.682189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.682514 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.683179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.686210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.719687 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1211/2393] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:10.725443 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:10.737526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b1bec-ebc7-44fc-81fb-5aa7f137af62 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:10.804848 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:10.805499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.805786 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.806061 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.806843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.808819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.832964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1183/2394] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:10 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:10.837116 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:10.848596 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9869a9-192d-4be3-bea0-a8e6da3c27fb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:10.853964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:10.854697 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.855041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.855394 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.856124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.858444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.860558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:10.875968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1212/2395] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:10.879304 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:10.890051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3de65-31a9-4fc9-afe6-ac7fce5f824a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:10.895269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87234694-eec4-4042-a898-ffdedaec0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:10.896006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234694-eec4-4042-a898-ffdedaec0b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.896293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234694-eec4-4042-a898-ffdedaec0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.896580 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234694-eec4-4042-a898-ffdedaec0b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.897313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87234694-eec4-4042-a898-ffdedaec0b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.898911 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87234694-eec4-4042-a898-ffdedaec0b56 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.916398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1184/2396] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:10.917725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:10.933291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921e0b7-49e9-4583-82ca-808dd7162573 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:10.939326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:10.940049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.940433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.940839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] PATH_INFO: `/v3/projects/826c584997a442d9946f6940e59de379/users/de1f1930d4f44c1591f24556dfbff6c6/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:10.960090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826c584997a442d9946f6940e59de379, user_id=de1f1930d4f44c1591f24556dfbff6c6, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:10.962857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:10.978332 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1213/2397] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:10 2022] PUT /identity/v3/projects/826c584997a442d9946f6940e59de379/users/de1f1930d4f44c1591f24556dfbff6c6/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:10.989482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:10.990027 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:10.990473 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:11.026725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] MFA Rules not processed for user `de1f1930d4f44c1591f24556dfbff6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:11.028707 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:11.120120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1185/2398] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:11.133166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:11.135057 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:11.197306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e61e-1179-47a7-bfbb-687d264a1614 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:11.201518 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecba463-0223-481a-a151-fc59ba9df10c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:11.202417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba463-0223-481a-a151-fc59ba9df10c service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:11.202926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba463-0223-481a-a151-fc59ba9df10c service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:11.203360 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba463-0223-481a-a151-fc59ba9df10c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:11.212519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecba463-0223-481a-a151-fc59ba9df10c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:11.214065 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecba463-0223-481a-a151-fc59ba9df10c service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:11.233023 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1214/2399] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:11.798739 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:11.800157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:11.865021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:11.901347 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c19b6d-296d-44b7-9e61-e6f4b1f96507 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:11.906499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:11.907371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:11.907662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:11.907983 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] PATH_INFO: `/v3/users/ebc6d95abf074985ae17504305eb0141` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:11.909227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc6d95abf074985ae17504305eb0141)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:11.911154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:11.963997 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc6d95abf074985ae17504305eb0141'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:11.964602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc6d95abf074985ae17504305eb0141'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:11.973291 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc6d95abf074985ae17504305eb0141'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:11.973956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc6d95abf074985ae17504305eb0141'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:11.989532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc6d95abf074985ae17504305eb0141'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.003367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1186/2400] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:11 2022] DELETE /identity/v3/users/ebc6d95abf074985ae17504305eb0141 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:12.009272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:12.009834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:12.010118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:12.036746 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:12.041243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:12.133384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1215/2401] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:12.142166 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:12.143661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:12.218282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0106c-f4a8-4bf5-8669-56b355df6c6a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:12.223275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:12.223962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:12.224672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:12.225049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:12.250270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:12.252397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:12.266937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1187/2402] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:12.574162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:12.575760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:12.594587 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd53c3-3d86-45d6-9424-96daa772af7c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:12.610240 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:12.610910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:12.611200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:12.611470 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] PATH_INFO: `/v3/projects/eaed77c1c90c46fead591201002bb511` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:12.612628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaed77c1c90c46fead591201002bb511)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:12.615213 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:12.674779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaed77c1c90c46fead591201002bb511', 'request_id': 'req-a61712f1-7d26-428a-b467-a118bbff10c2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.682508 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaed77c1c90c46fead591201002bb511', 'request_id': 'req-a61712f1-7d26-428a-b467-a118bbff10c2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.696439 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaed77c1c90c46fead591201002bb511', 'request_id': 'req-a61712f1-7d26-428a-b467-a118bbff10c2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.704899 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:12.710793 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] The token cache is being invalidate because project eaed77c1c90c46fead591201002bb511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:12.711131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.712411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.714985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1216/2403] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:12 2022] DELETE /identity/v3/projects/eaed77c1c90c46fead591201002bb511 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:12.719573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:12.730242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9ba89-c3f6-4203-abca-f0a3c6751cc7 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:12.793760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:12.794837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:12.795150 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:12.795538 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] PATH_INFO: `/v3/users/e8941a54a71f4415997777655bd9cee1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:12.796754 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8941a54a71f4415997777655bd9cee1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:12.798687 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:12.800476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:12.875370 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8941a54a71f4415997777655bd9cee1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.876099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8941a54a71f4415997777655bd9cee1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.896168 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8941a54a71f4415997777655bd9cee1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.896834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8941a54a71f4415997777655bd9cee1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.911635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8941a54a71f4415997777655bd9cee1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.926212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1188/2404] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:12 2022] DELETE /identity/v3/users/e8941a54a71f4415997777655bd9cee1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:13.302830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:13.311654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:13.325131 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61712f1-7d26-428a-b467-a118bbff10c2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:13.396992 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:13.398344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.398878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.399313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] PATH_INFO: `/v3/projects/e629b76100b1464ca4b96b84a41e303d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.400789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e629b76100b1464ca4b96b84a41e303d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:13.402939 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:13.461104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e629b76100b1464ca4b96b84a41e303d', 'request_id': 'req-099572bf-49b9-4d33-9212-5cea2f5660ab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.470885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e629b76100b1464ca4b96b84a41e303d', 'request_id': 'req-099572bf-49b9-4d33-9212-5cea2f5660ab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.479047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e629b76100b1464ca4b96b84a41e303d', 'request_id': 'req-099572bf-49b9-4d33-9212-5cea2f5660ab'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.494944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] The token cache is being invalidate because project e629b76100b1464ca4b96b84a41e303d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:13.495254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.495982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.498440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1217/2405] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:13 2022] DELETE /identity/v3/projects/e629b76100b1464ca4b96b84a41e303d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:13.502330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:13.503837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:13.520456 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091794-d85b-42c0-90a9-7b591a1c84a8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:13.589189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:13.589883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.590208 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.590509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] PATH_INFO: `/v3/users/ddb703b9c4ed41018eeac4985c86b475` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.592320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb703b9c4ed41018eeac4985c86b475)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:13.596742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:13.663770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb703b9c4ed41018eeac4985c86b475'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.664478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb703b9c4ed41018eeac4985c86b475'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.674773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb703b9c4ed41018eeac4985c86b475'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.675865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb703b9c4ed41018eeac4985c86b475'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.689515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d09ca190-3133-4946-9bb4-e3b5dbde79a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb703b9c4ed41018eeac4985c86b475'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.705834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:13.722445 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1189/2406] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:13 2022] DELETE /identity/v3/users/ddb703b9c4ed41018eeac4985c86b475 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:14.059195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.060768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:14.077784 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099572bf-49b9-4d33-9212-5cea2f5660ab admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.157018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.157762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.158118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.158424 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] PATH_INFO: `/v3/projects/46ec3a5b2b784b059abde9325de42256` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.159560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ec3a5b2b784b059abde9325de42256)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.161624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.198355 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:14.217440 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ec3a5b2b784b059abde9325de42256', 'request_id': 'req-0dd66e68-6f4c-4d86-870d-060eee5e07be'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:14.226212 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ec3a5b2b784b059abde9325de42256', 'request_id': 'req-0dd66e68-6f4c-4d86-870d-060eee5e07be'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:14.233386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ec3a5b2b784b059abde9325de42256', 'request_id': 'req-0dd66e68-6f4c-4d86-870d-060eee5e07be'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:14.248904 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] The token cache is being invalidate because project 46ec3a5b2b784b059abde9325de42256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:14.249153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:14.250067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0dd66e68-6f4c-4d86-870d-060eee5e07be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:14.251879 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1218/2407] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:14 2022] DELETE /identity/v3/projects/46ec3a5b2b784b059abde9325de42256 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:14.259058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f8bb-fc4e-45e8-b46a-b82399cc00e5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.259344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f8bb-fc4e-45e8-b46a-b82399cc00e5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.259631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f8bb-fc4e-45e8-b46a-b82399cc00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.281068 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ed00f8bb-fc4e-45e8-b46a-b82399cc00e5 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:14.282287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed00f8bb-fc4e-45e8-b46a-b82399cc00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:14.353528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1190/2408] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:14.362020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cf0a-12c3-42f8-8211-4b5a60e057ca None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.362547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cf0a-12c3-42f8-8211-4b5a60e057ca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.362717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cf0a-12c3-42f8-8211-4b5a60e057ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.383872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-64b9cf0a-12c3-42f8-8211-4b5a60e057ca None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:14.385120 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64b9cf0a-12c3-42f8-8211-4b5a60e057ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:14.394751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1219/2409] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:14.398958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f8bb-fc4e-45e8-b46a-b82399cc00e5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.411079 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f8bb-fc4e-45e8-b46a-b82399cc00e5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.415998 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.416758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.417074 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.417404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.418224 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:14.418529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.420680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.437651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1191/2410] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:14.438788 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9cf0a-12c3-42f8-8211-4b5a60e057ca None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.448990 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9cf0a-12c3-42f8-8211-4b5a60e057ca None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.454397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.454985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.455263 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.455532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.456188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.458143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.490797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1220/2411] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:14 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:14.492139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.505200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1ba3d-3818-41fa-b35d-d33b42cde7f1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.567638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.568439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.568878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.569215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.569881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.571905 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.605654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1192/2412] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:14 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:14.610654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.621748 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4fcd5-97ea-4d7d-b3f4-c0f034056433 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.628147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.628908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.629385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.629665 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.630379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.632413 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.650637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1221/2413] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:14.652288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.663523 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918f499-c743-4b37-a7d6-33cadcc51266 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.670382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a39d6-1cd4-4205-86e9-4adad60c8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.671087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a39d6-1cd4-4205-86e9-4adad60c8778 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.671431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a39d6-1cd4-4205-86e9-4adad60c8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.671711 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a39d6-1cd4-4205-86e9-4adad60c8778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.672422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a39d6-1cd4-4205-86e9-4adad60c8778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.674701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a39d6-1cd4-4205-86e9-4adad60c8778 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.689013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1193/2414] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:14.691202 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.704832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2ba02-238a-4ea3-a83a-8fb0804411e7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.716374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.717408 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.717689 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.717975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] PATH_INFO: `/v3/projects/46e0b4adce86416d8e58639cd68c72e3/users/8194e2e9217f4cbc885f89d5ee80769e/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.735610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e0b4adce86416d8e58639cd68c72e3, user_id=8194e2e9217f4cbc885f89d5ee80769e, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.738397 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.754857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1222/2415] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:14 2022] PUT /identity/v3/projects/46e0b4adce86416d8e58639cd68c72e3/users/8194e2e9217f4cbc885f89d5ee80769e/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:14.826103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cdbad-6b76-4ad5-9098-0f87b879657c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.826354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cdbad-6b76-4ad5-9098-0f87b879657c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.826570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cdbad-6b76-4ad5-9098-0f87b879657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.857836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ac4cdbad-6b76-4ad5-9098-0f87b879657c None None] MFA Rules not processed for user `8194e2e9217f4cbc885f89d5ee80769e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:14.859044 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ac4cdbad-6b76-4ad5-9098-0f87b879657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:14.921651 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:14.933836 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1194/2416] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:14.939145 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:15.040567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef28cd4-5979-4387-b6bd-a8fd4b03b97a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:15.046090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:15.046711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.046984 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.047255 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.047902 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:15.049857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:15.084056 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1223/2417] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:14 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:15.088164 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cdbad-6b76-4ad5-9098-0f87b879657c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:15.100595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cdbad-6b76-4ad5-9098-0f87b879657c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:15.184514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:15.185169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.185448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.185730 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.186585 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:15.188512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:15.212235 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1195/2418] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:15 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:15.217028 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:15.228901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46a73-0955-4501-a1f8-af8917e5acca admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:15.235798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:15.236517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.236871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.237305 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.237968 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:15.239678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:15.254650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1224/2419] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:18:15.255875 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:15.267590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc9de-fca3-4528-aa90-1bda715dc766 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:15.272748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:15.273620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.274067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.274573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] PATH_INFO: `/v3/projects/61141f900e1f4ddb8ccee29d6f041454/users/a0882d406087452d8d4f3da149b52576/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.292819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61141f900e1f4ddb8ccee29d6f041454, user_id=a0882d406087452d8d4f3da149b52576, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:15.297003 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:15.311533 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1196/2420] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:15 2022] PUT /identity/v3/projects/61141f900e1f4ddb8ccee29d6f041454/users/a0882d406087452d8d4f3da149b52576/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:15.315639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:15.326024 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c9fd-5c39-4c22-9cd6-cd2059e489c3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:15.355900 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:15.398637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cb46-c2ae-47c0-b4a4-4972007b6898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:15.400317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb46-c2ae-47c0-b4a4-4972007b6898 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.400865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb46-c2ae-47c0-b4a4-4972007b6898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.401111 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb46-c2ae-47c0-b4a4-4972007b6898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.401923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cb46-c2ae-47c0-b4a4-4972007b6898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:15.404067 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cb46-c2ae-47c0-b4a4-4972007b6898 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:15.417011 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1225/2421] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:15.422011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:15.432871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6bf34-2206-42c0-8070-763cdb9d9614 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:15.442779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:15.443480 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.443981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.444127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] PATH_INFO: `/v3/projects/61141f900e1f4ddb8ccee29d6f041454/users/a0882d406087452d8d4f3da149b52576/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.446120 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61141f900e1f4ddb8ccee29d6f041454, user_id=a0882d406087452d8d4f3da149b52576, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:15.448813 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:15.460996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1197/2422] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:15 2022] PUT /identity/v3/projects/61141f900e1f4ddb8ccee29d6f041454/users/a0882d406087452d8d4f3da149b52576/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:15.471372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf8f9a-8569-48fd-95c7-4e678efa33a6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.471663 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf8f9a-8569-48fd-95c7-4e678efa33a6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.472045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf8f9a-8569-48fd-95c7-4e678efa33a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.506433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8bcf8f9a-8569-48fd-95c7-4e678efa33a6 None None] MFA Rules not processed for user `a0882d406087452d8d4f3da149b52576`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:15.507809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8bcf8f9a-8569-48fd-95c7-4e678efa33a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:15.590453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1226/2423] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:15.598198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:15.600212 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:15.663509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed776b2-5339-4051-9381-5c00c8526b8b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:15.667676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232e33-13d8-4d3e-afc9-9d4eb8951d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:15.668462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232e33-13d8-4d3e-afc9-9d4eb8951d2c service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:15.668741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232e33-13d8-4d3e-afc9-9d4eb8951d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:15.669592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232e33-13d8-4d3e-afc9-9d4eb8951d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:15.741713 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73232e33-13d8-4d3e-afc9-9d4eb8951d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:15.743360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73232e33-13d8-4d3e-afc9-9d4eb8951d2c service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:15.750040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:15.755647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1198/2424] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:18.395292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf8f9a-8569-48fd-95c7-4e678efa33a6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:18.468256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf8f9a-8569-48fd-95c7-4e678efa33a6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:18.473387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:18.474723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:18.474997 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:18.475272 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] PATH_INFO: `/v3/users/8194e2e9217f4cbc885f89d5ee80769e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:18.476406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8194e2e9217f4cbc885f89d5ee80769e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:18.478576 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:18.536323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8194e2e9217f4cbc885f89d5ee80769e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:18.541946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:18.550223 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8194e2e9217f4cbc885f89d5ee80769e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:18.550923 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8194e2e9217f4cbc885f89d5ee80769e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:18.551557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8194e2e9217f4cbc885f89d5ee80769e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:18.568399 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8194e2e9217f4cbc885f89d5ee80769e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:18.583537 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1227/2425] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:18 2022] DELETE /identity/v3/users/8194e2e9217f4cbc885f89d5ee80769e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:18.588140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:18.588824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:18.588824 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:18.613002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:18.613002 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:18.686409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1199/2426] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:18.696387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:18.698075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:18.776617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c2ab7-bba9-4a1e-b48a-740e1b23fb71 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:18.782140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:18.782866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:18.783221 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:18.783568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:18.795239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:18.796637 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:18.807872 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1228/2427] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:19.138896 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:19.141065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:19.155352 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba9a07-21d4-4bfb-afb3-33375544c36f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:19.160494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:19.161189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.161471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.161741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] PATH_INFO: `/v3/projects/46e0b4adce86416d8e58639cd68c72e3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.163052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e0b4adce86416d8e58639cd68c72e3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:19.165171 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:19.233305 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e0b4adce86416d8e58639cd68c72e3', 'request_id': 'req-6d6faef3-da49-4de4-9585-5ee0b16799cc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.239110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e0b4adce86416d8e58639cd68c72e3', 'request_id': 'req-6d6faef3-da49-4de4-9585-5ee0b16799cc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.253376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e0b4adce86416d8e58639cd68c72e3', 'request_id': 'req-6d6faef3-da49-4de4-9585-5ee0b16799cc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.267908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] The token cache is being invalidate because project 46e0b4adce86416d8e58639cd68c72e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:19.268202 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.268893 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.270607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1200/2428] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:19 2022] DELETE /identity/v3/projects/46e0b4adce86416d8e58639cd68c72e3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:19.274490 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:19.285314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efcbd-7b6f-412a-8ca9-d7309d6f94f2 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:19.353447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:19.354341 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.354780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.355203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] PATH_INFO: `/v3/users/a0882d406087452d8d4f3da149b52576` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.356403 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0882d406087452d8d4f3da149b52576)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:19.358624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:19.419239 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0882d406087452d8d4f3da149b52576'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.426144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0882d406087452d8d4f3da149b52576'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.426807 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0882d406087452d8d4f3da149b52576'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.427432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0882d406087452d8d4f3da149b52576'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.439110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3aa8aa98-0680-4336-9241-7e6b79241d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0882d406087452d8d4f3da149b52576'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.440737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:19.453962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1229/2429] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:19 2022] DELETE /identity/v3/users/a0882d406087452d8d4f3da149b52576 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:19.749275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:19.750784 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:19.771174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6faef3-da49-4de4-9585-5ee0b16799cc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:19.831102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:19.831646 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.831924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.832200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] PATH_INFO: `/v3/projects/61141f900e1f4ddb8ccee29d6f041454` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.833342 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61141f900e1f4ddb8ccee29d6f041454)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:19.835230 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:19.865920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:19.884526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61141f900e1f4ddb8ccee29d6f041454', 'request_id': 'req-45d107e9-9702-463b-a62e-01d0bde218f5'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.890826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61141f900e1f4ddb8ccee29d6f041454', 'request_id': 'req-45d107e9-9702-463b-a62e-01d0bde218f5'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.898072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61141f900e1f4ddb8ccee29d6f041454', 'request_id': 'req-45d107e9-9702-463b-a62e-01d0bde218f5'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.910180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] The token cache is being invalidate because project 61141f900e1f4ddb8ccee29d6f041454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:19.910467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.911084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-45d107e9-9702-463b-a62e-01d0bde218f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:19.912567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1201/2430] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:19 2022] DELETE /identity/v3/projects/61141f900e1f4ddb8ccee29d6f041454 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:19.917314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3926c14-2738-45ea-8d39-1fc5d3d214ef None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.917606 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3926c14-2738-45ea-8d39-1fc5d3d214ef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.917876 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3926c14-2738-45ea-8d39-1fc5d3d214ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.937963 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b3926c14-2738-45ea-8d39-1fc5d3d214ef None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:19.939403 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b3926c14-2738-45ea-8d39-1fc5d3d214ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:20.000227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1230/2431] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:20.007977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f370aa-9e8d-4d17-9343-a699ad9b4168 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.008262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f370aa-9e8d-4d17-9343-a699ad9b4168 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.008534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f370aa-9e8d-4d17-9343-a699ad9b4168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.029853 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-37f370aa-9e8d-4d17-9343-a699ad9b4168 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:20.031104 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-37f370aa-9e8d-4d17-9343-a699ad9b4168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:20.039156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1202/2432] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:20.043522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3926c14-2738-45ea-8d39-1fc5d3d214ef None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.053763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3926c14-2738-45ea-8d39-1fc5d3d214ef None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.058359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.058954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.059237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.059598 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.060249 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:20.060551 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.062179 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.073531 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1231/2433] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:20.078427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f370aa-9e8d-4d17-9343-a699ad9b4168 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.088090 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f370aa-9e8d-4d17-9343-a699ad9b4168 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.093194 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.093788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.094066 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.094335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.094971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.096876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.125116 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1203/2434] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:20 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:20.130291 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.141137 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f483a-fb55-460f-b57d-4f97aea4c5b9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.198608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.199228 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.199526 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.199779 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.200909 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.202858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.225438 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1232/2435] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:20 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:20.229411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.240040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da74b5-c7ec-4f4a-a4be-2c9d9d66d753 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.245152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.245770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.246048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.246325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.247023 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.248610 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.259086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1204/2436] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:20.263345 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.273151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba25f6-fdfb-459d-9c0e-6f7b0131ff55 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.277781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a1822-04bf-433d-84f3-0243bd222b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.279484 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a1822-04bf-433d-84f3-0243bd222b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.279768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a1822-04bf-433d-84f3-0243bd222b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.280040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a1822-04bf-433d-84f3-0243bd222b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.280781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a1822-04bf-433d-84f3-0243bd222b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.282392 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a1822-04bf-433d-84f3-0243bd222b7f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.295449 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1233/2437] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:20.299901 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.310123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97743c-8827-4284-a3e7-6f08410cadb7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.314977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.315634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.315928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.316319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] PATH_INFO: `/v3/projects/ca904f036bdf4798ab50df67b76ff378/users/75dae9927241406482e57b6f0a75ba1f/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.332081 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca904f036bdf4798ab50df67b76ff378, user_id=75dae9927241406482e57b6f0a75ba1f, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.334778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.348050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1205/2438] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:20 2022] PUT /identity/v3/projects/ca904f036bdf4798ab50df67b76ff378/users/75dae9927241406482e57b6f0a75ba1f/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:20.360495 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557468c-398f-4cf0-90c6-9e46233a865c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.360773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557468c-398f-4cf0-90c6-9e46233a865c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.361080 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557468c-398f-4cf0-90c6-9e46233a865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.395006 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f557468c-398f-4cf0-90c6-9e46233a865c None None] MFA Rules not processed for user `75dae9927241406482e57b6f0a75ba1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:20.396256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f557468c-398f-4cf0-90c6-9e46233a865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:20.461773 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:20.485572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1234/2439] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:20.497326 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.499015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:20.519567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c0032-9a83-443b-8768-a89f67d629c3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.519858 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c0032-9a83-443b-8768-a89f67d629c3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.520134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c0032-9a83-443b-8768-a89f67d629c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.541459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-501c0032-9a83-443b-8768-a89f67d629c3 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:20.542712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-501c0032-9a83-443b-8768-a89f67d629c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:20.562606 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83298b1-4d1c-45c0-a4b6-9188e04a76dd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.566753 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.567364 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.567641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.567931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.577944 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.579398 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.589677 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1206/2440] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:20.601558 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1235/2441] 10.222.0.25 () {58 vars in 967 bytes} [Sun Oct 23 02:18:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:20.614964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.616363 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:20.676103 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:20.697876 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3275c87-44a0-4dc6-90b7-577696e837e9 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.703157 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.703762 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.704054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.704319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.714764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.716419 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.725684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1207/2442] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:18:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:22.008306 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:22.008785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:22.008913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:22.029343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] MFA Rules not processed for user `75dae9927241406482e57b6f0a75ba1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:22.030546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:22.037299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1236/2443] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:22.991799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:22.994838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:23.068611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:23.071331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:23.078578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251877-1967-4632-ba95-16a885604a2b service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:23.084882 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:23.085742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:23.086035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:23.086298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:23.088073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:23.102963 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:23.104386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:23.121534 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1208/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:23.150827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc392b-8399-463b-9aac-2935a0320432 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:23.156577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:23.157258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:23.157539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:23.157814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] PATH_INFO: `/v3/users/69ebcf96dd6d4e74a777604c919b3198` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:23.158938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ebcf96dd6d4e74a777604c919b3198)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:23.160854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:23.216391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ebcf96dd6d4e74a777604c919b3198'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.225331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ebcf96dd6d4e74a777604c919b3198'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.226015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ebcf96dd6d4e74a777604c919b3198'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.226620 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ebcf96dd6d4e74a777604c919b3198'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.239339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ebcf96dd6d4e74a777604c919b3198'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.253955 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1237/2445] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:23 2022] DELETE /identity/v3/users/69ebcf96dd6d4e74a777604c919b3198 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:23.432512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:23.443531 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001bc3-bf85-44f9-a312-0a312b89e177 service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:23.501416 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:23.502054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:23.502335 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:23.502609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] PATH_INFO: `/v3/projects/7246c2c09e064411900fb9b5ce391e6a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:23.503716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7246c2c09e064411900fb9b5ce391e6a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:23.505666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:23.553921 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7246c2c09e064411900fb9b5ce391e6a', 'request_id': 'req-e5467543-8aef-4243-9cac-c32de12151cf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.559307 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7246c2c09e064411900fb9b5ce391e6a', 'request_id': 'req-e5467543-8aef-4243-9cac-c32de12151cf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.566521 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7246c2c09e064411900fb9b5ce391e6a', 'request_id': 'req-e5467543-8aef-4243-9cac-c32de12151cf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.577918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] The token cache is being invalidate because project 7246c2c09e064411900fb9b5ce391e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:23.578216 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.578847 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5467543-8aef-4243-9cac-c32de12151cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:23.580514 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1209/2446] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:23 2022] DELETE /identity/v3/projects/7246c2c09e064411900fb9b5ce391e6a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:29.217866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:29.219312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:29.228624 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:29.232896 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaec69-1a52-4d2d-9edd-86533e195813 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:29.289542 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:29.290168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:29.290448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:29.290735 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] PATH_INFO: `/v3/users/de1f1930d4f44c1591f24556dfbff6c6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:29.291830 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1f1930d4f44c1591f24556dfbff6c6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:29.294525 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:29.338373 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1f1930d4f44c1591f24556dfbff6c6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.345681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1f1930d4f44c1591f24556dfbff6c6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.346326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1f1930d4f44c1591f24556dfbff6c6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.346919 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1f1930d4f44c1591f24556dfbff6c6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.359334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1f1930d4f44c1591f24556dfbff6c6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.371528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1238/2447] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:29 2022] DELETE /identity/v3/users/de1f1930d4f44c1591f24556dfbff6c6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:29.375933 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:29.376418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:29.376518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:29.383443 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:29.397421 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:29.398614 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:29.455217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1210/2448] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:29.465147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:29.467098 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:29.523529 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251413-f379-4027-8b06-3588277db99d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:29.527354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66199a59-9475-46c6-86af-129ac32ba449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:29.528668 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66199a59-9475-46c6-86af-129ac32ba449 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:29.528961 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66199a59-9475-46c6-86af-129ac32ba449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:29.529268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66199a59-9475-46c6-86af-129ac32ba449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:29.538390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66199a59-9475-46c6-86af-129ac32ba449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:29.539857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66199a59-9475-46c6-86af-129ac32ba449 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:29.549686 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1239/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:18:29.814752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:29.816139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:29.837932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07b966-3691-470a-a468-4b80debdf247 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:29.843037 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:29.843981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:29.844273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:29.844542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] PATH_INFO: `/v3/projects/826c584997a442d9946f6940e59de379` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:29.845798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826c584997a442d9946f6940e59de379)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:29.847741 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:29.906462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826c584997a442d9946f6940e59de379', 'request_id': 'req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.916205 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826c584997a442d9946f6940e59de379', 'request_id': 'req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.929518 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826c584997a442d9946f6940e59de379', 'request_id': 'req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.952131 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] The token cache is being invalidate because project 826c584997a442d9946f6940e59de379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:29.952483 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.953114 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5063d589-6e6e-4fe4-8f2b-9713cdc890f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:29.955306 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1211/2450] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:29 2022] DELETE /identity/v3/projects/826c584997a442d9946f6940e59de379 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:29.960018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17f39-67be-4084-aa5e-1173eb49f32d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:29.960601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17f39-67be-4084-aa5e-1173eb49f32d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:29.961167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17f39-67be-4084-aa5e-1173eb49f32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:29.983922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-93e17f39-67be-4084-aa5e-1173eb49f32d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:29.986346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-93e17f39-67be-4084-aa5e-1173eb49f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:30.012608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:30.054329 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1240/2451] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:30.062664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2061-8dbb-40f1-9bc8-613104414bc8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.062950 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2061-8dbb-40f1-9bc8-613104414bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.063227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2061-8dbb-40f1-9bc8-613104414bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.083656 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f1ed2061-8dbb-40f1-9bc8-613104414bc8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:30.084880 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f1ed2061-8dbb-40f1-9bc8-613104414bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:30.093192 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1212/2452] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:30.097534 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e17f39-67be-4084-aa5e-1173eb49f32d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:30.107573 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e17f39-67be-4084-aa5e-1173eb49f32d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:30.117718 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:30.118375 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.118646 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.118921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.119579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:30.119885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:30.122047 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:30.138696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1241/2453] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:30.140095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2061-8dbb-40f1-9bc8-613104414bc8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:30.149926 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2061-8dbb-40f1-9bc8-613104414bc8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:30.154630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:30.155225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.155503 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.155775 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.156397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:30.158377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:30.186161 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1213/2454] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:30 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:30.190451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:30.200519 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2930-42c4-49eb-b8f5-5eec38a72425 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:30.257946 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:30.258622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.258912 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.259117 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.259930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:30.261983 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:30.285783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1242/2455] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:30 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:30.287030 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:30.299889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41016-5d00-49f7-8000-0af80b6b5552 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:30.304841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:30.305556 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.305906 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.306242 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.307019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:30.308691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:30.320755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1214/2456] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:30.324865 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:30.335832 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3fdd-0b13-4777-8aa0-3c01c13dbd15 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:30.340777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca62f0-2e50-42f4-ae09-60152f1dc52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:30.341550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca62f0-2e50-42f4-ae09-60152f1dc52a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.341824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca62f0-2e50-42f4-ae09-60152f1dc52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.342075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca62f0-2e50-42f4-ae09-60152f1dc52a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.342712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca62f0-2e50-42f4-ae09-60152f1dc52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:30.344299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca62f0-2e50-42f4-ae09-60152f1dc52a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:30.355538 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1243/2457] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:30.360195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:30.370181 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106aa60-b89f-40f5-9a2d-c84739a12a56 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:30.375917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:30.376614 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.377217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.377217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] PATH_INFO: `/v3/projects/e8a739e1162c49c1a048b62b240593ef/users/b6aae8071dbe4e1f90d54670237e5514/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.394294 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a739e1162c49c1a048b62b240593ef, user_id=b6aae8071dbe4e1f90d54670237e5514, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:30.397327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:30.413413 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1215/2458] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:30 2022] PUT /identity/v3/projects/e8a739e1162c49c1a048b62b240593ef/users/b6aae8071dbe4e1f90d54670237e5514/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:30.425844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c31e1-8102-4831-8386-0803747e3d50 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.425844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c31e1-8102-4831-8386-0803747e3d50 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.426136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c31e1-8102-4831-8386-0803747e3d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.456403 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c53c31e1-8102-4831-8386-0803747e3d50 None None] MFA Rules not processed for user `b6aae8071dbe4e1f90d54670237e5514`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:30.457760 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c53c31e1-8102-4831-8386-0803747e3d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:30.525617 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1244/2459] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:30.537709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:30.539444 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:30.566236 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:30.602770 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52af8-1923-4cfa-91eb-8fa45b70989a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:30.606902 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641a54-7750-47b8-9260-6f96a1187bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:30.607507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641a54-7750-47b8-9260-6f96a1187bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:30.607780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641a54-7750-47b8-9260-6f96a1187bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:30.608048 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641a54-7750-47b8-9260-6f96a1187bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:30.617196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d641a54-7750-47b8-9260-6f96a1187bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:30.618608 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d641a54-7750-47b8-9260-6f96a1187bb8 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:30.627650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1216/2460] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:33.175452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c31e1-8102-4831-8386-0803747e3d50 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:33.200261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:33.238254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c31e1-8102-4831-8386-0803747e3d50 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:33.242667 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:33.243292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:33.243574 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:33.243843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] PATH_INFO: `/v3/users/b6aae8071dbe4e1f90d54670237e5514` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:33.244941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6aae8071dbe4e1f90d54670237e5514)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:33.247550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:33.292851 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6aae8071dbe4e1f90d54670237e5514'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:33.300434 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6aae8071dbe4e1f90d54670237e5514'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:33.301301 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6aae8071dbe4e1f90d54670237e5514'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:33.301914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6aae8071dbe4e1f90d54670237e5514'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:33.315294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6aae8071dbe4e1f90d54670237e5514'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:33.328766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1245/2461] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:33 2022] DELETE /identity/v3/users/b6aae8071dbe4e1f90d54670237e5514 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:33.333222 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:33.333722 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:33.333822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:33.354186 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:33.355414 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:33.426325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1217/2462] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:33.436728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:33.440082 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:33.497465 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224e58-893f-4304-b448-9bd93058e852 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:33.502041 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5d05e-1142-4f12-91af-731f79afcffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:33.502650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5d05e-1142-4f12-91af-731f79afcffd service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:33.502926 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5d05e-1142-4f12-91af-731f79afcffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:33.503193 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5d05e-1142-4f12-91af-731f79afcffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:33.512477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5d05e-1142-4f12-91af-731f79afcffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:33.514513 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5d05e-1142-4f12-91af-731f79afcffd service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:33.524218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1246/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:33.971156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:33.972664 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:34.012684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de2ce-884c-407b-921c-fbacfcfb779f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.026190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.026843 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.027143 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.027495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] PATH_INFO: `/v3/projects/e8a739e1162c49c1a048b62b240593ef` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.029912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a739e1162c49c1a048b62b240593ef)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.031818 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.084468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a739e1162c49c1a048b62b240593ef', 'request_id': 'req-d99bd19d-b559-4352-8e57-2370ba5577aa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:34.090526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a739e1162c49c1a048b62b240593ef', 'request_id': 'req-d99bd19d-b559-4352-8e57-2370ba5577aa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:34.098975 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a739e1162c49c1a048b62b240593ef', 'request_id': 'req-d99bd19d-b559-4352-8e57-2370ba5577aa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:34.118634 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] The token cache is being invalidate because project e8a739e1162c49c1a048b62b240593ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:34.118962 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:34.119881 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d99bd19d-b559-4352-8e57-2370ba5577aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:34.121591 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1218/2464] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:33 2022] DELETE /identity/v3/projects/e8a739e1162c49c1a048b62b240593ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:34.126540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b584-b0e6-457c-a3d7-f79f95a3838d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.126914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b584-b0e6-457c-a3d7-f79f95a3838d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.127259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b584-b0e6-457c-a3d7-f79f95a3838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.147989 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7af2b584-b0e6-457c-a3d7-f79f95a3838d None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:34.149276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7af2b584-b0e6-457c-a3d7-f79f95a3838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:34.192347 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:34.213578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1247/2465] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:34.221647 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc3086-006b-417e-9858-037dce1305c8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.221925 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc3086-006b-417e-9858-037dce1305c8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.222198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc3086-006b-417e-9858-037dce1305c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.242982 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b7cc3086-006b-417e-9858-037dce1305c8 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:34.244204 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b7cc3086-006b-417e-9858-037dce1305c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:34.253067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1219/2466] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:34.257570 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2b584-b0e6-457c-a3d7-f79f95a3838d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:34.268050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2b584-b0e6-457c-a3d7-f79f95a3838d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.272721 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.273370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.273641 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.273908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.274559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:34.274861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.276461 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.289002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1248/2467] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:34.293336 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc3086-006b-417e-9858-037dce1305c8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:34.302923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc3086-006b-417e-9858-037dce1305c8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.308100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.308801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.309195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.309544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.310792 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.312783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.350508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1220/2468] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:34 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:34.351446 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:34.362812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53a74c-8698-41c0-b187-bf302057f446 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.436806 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.437676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.438022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.438356 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.439055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.441362 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.466758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1249/2469] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:34 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:34.471020 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:34.483458 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb6a9-c490-43ac-a66c-45a116f7aa2c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.497379 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.498334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.498688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.499033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.499752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.501507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.517016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1221/2470] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:34.517931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:34.528515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f59dd-7478-4697-aefc-5b400b3610d0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.534254 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77afb-e79a-4bfa-9cd9-6b43bb275122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.534938 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77afb-e79a-4bfa-9cd9-6b43bb275122 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.535294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77afb-e79a-4bfa-9cd9-6b43bb275122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.535662 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77afb-e79a-4bfa-9cd9-6b43bb275122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.536386 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77afb-e79a-4bfa-9cd9-6b43bb275122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.538252 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77afb-e79a-4bfa-9cd9-6b43bb275122 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.559493 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:34.565129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1250/2471] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:34.573129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc01fae-38ff-4406-89b5-f36ee81ad109 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.578706 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.579457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.579833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.580238 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] PATH_INFO: `/v3/projects/7c4ae8f34a38453bb85e05a9ef0140ff/users/3f44ef2f40f74bd1ab3617e05778f9b7/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.585213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:34.600793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4ae8f34a38453bb85e05a9ef0140ff, user_id=3f44ef2f40f74bd1ab3617e05778f9b7, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.604142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.617810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1222/2472] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:34 2022] PUT /identity/v3/projects/7c4ae8f34a38453bb85e05a9ef0140ff/users/3f44ef2f40f74bd1ab3617e05778f9b7/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:34.629562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa63d-b23e-4f12-b887-0b19d7171d05 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.629920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa63d-b23e-4f12-b887-0b19d7171d05 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.630294 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa63d-b23e-4f12-b887-0b19d7171d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.659406 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9bcfa63d-b23e-4f12-b887-0b19d7171d05 None None] MFA Rules not processed for user `3f44ef2f40f74bd1ab3617e05778f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:34.660674 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9bcfa63d-b23e-4f12-b887-0b19d7171d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:34.727458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1251/2473] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:34.739321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:34.741073 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:34.803841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322351a-3fad-4629-8927-9c32e3ad9d7e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:34.807658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:34.808562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:34.808562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:34.808799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:34.821343 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:34.822780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:34.833132 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1223/2474] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:37.547634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8299abb-758a-4e6d-9a83-37a48a6f94f6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:37.548136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8299abb-758a-4e6d-9a83-37a48a6f94f6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:37.548238 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8299abb-758a-4e6d-9a83-37a48a6f94f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:37.567654 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d8299abb-758a-4e6d-9a83-37a48a6f94f6 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:37.568840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d8299abb-758a-4e6d-9a83-37a48a6f94f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:37.603327 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:37.628234 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1252/2475] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:18:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:37.640431 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:37.641868 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:37.712936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d44e1e-6296-4f83-b1a8-947dad43fd63 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:37.718072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:37.718699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:37.719006 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:37.719278 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:37.727642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:37.729273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:37.738552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1224/2476] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:38.295339 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3f8f-a8dd-41aa-a8fe-194262639f4f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:38.295633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3f8f-a8dd-41aa-a8fe-194262639f4f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:38.295901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3f8f-a8dd-41aa-a8fe-194262639f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:38.315458 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-529c3f8f-a8dd-41aa-a8fe-194262639f4f None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:38.316661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-529c3f8f-a8dd-41aa-a8fe-194262639f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:38.323949 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1253/2477] 10.222.0.25 () {58 vars in 967 bytes} [Sun Oct 23 02:18:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:38.336746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:38.347270 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe905d6-e964-486e-9fa1-1b4a191dcdc4 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:38.352577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:38.353206 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:38.353486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:38.353757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:38.362254 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:38.363800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:38.371858 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1225/2478] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:38.591962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642664-37ad-4125-8dc1-9522001ea4b6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:38.592475 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642664-37ad-4125-8dc1-9522001ea4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:38.592579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642664-37ad-4125-8dc1-9522001ea4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:38.611789 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-98642664-37ad-4125-8dc1-9522001ea4b6 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:38.612951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-98642664-37ad-4125-8dc1-9522001ea4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:38.619951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1254/2479] 10.222.0.25 () {58 vars in 1009 bytes} [Sun Oct 23 02:18:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:38.631801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:38.642661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105a7ad-df54-4113-90ab-c28a661aba11 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:38.647669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:38.648259 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:38.648537 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:38.648811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:38.657371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:38.658866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:38.666734 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1226/2480] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:39.010924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0028f-a0e7-4ed9-a41e-fef8638ba4b7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:39.010924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0028f-a0e7-4ed9-a41e-fef8638ba4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:39.010924 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0028f-a0e7-4ed9-a41e-fef8638ba4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:39.040311 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-65e0028f-a0e7-4ed9-a41e-fef8638ba4b7 None None] MFA Rules not processed for user `45303f5dcc7f443ea077ef751eb725bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:39.041549 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65e0028f-a0e7-4ed9-a41e-fef8638ba4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:39.053437 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1255/2481] 10.222.0.25 () {58 vars in 967 bytes} [Sun Oct 23 02:18:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:39.055704 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:39.057250 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:39.066474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0028f-a0e7-4ed9-a41e-fef8638ba4b7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:39.079647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0028f-a0e7-4ed9-a41e-fef8638ba4b7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:39.085522 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '349cd8f8431a43a698e9cb4e3536f59a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:39.086320 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:39.086680 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:39.087008 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:39.096231 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:39.098090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:39.108372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1256/2482] 10.222.0.25 () {60 vars in 1384 bytes} [Sun Oct 23 02:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 02:18:39.123033 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971cb8b-11eb-46a7-ba5c-a16148928530 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:39.127190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b0a24-9606-4baf-b06e-03abd0e34fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:39.127801 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b0a24-9606-4baf-b06e-03abd0e34fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:39.128213 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b0a24-9606-4baf-b06e-03abd0e34fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:39.128415 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b0a24-9606-4baf-b06e-03abd0e34fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:39.130141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ad3b0a24-9606-4baf-b06e-03abd0e34fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:39.135474 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:39.201752 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b0a24-9606-4baf-b06e-03abd0e34fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:39.203190 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b0a24-9606-4baf-b06e-03abd0e34fa1 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:39.214292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1227/2483] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:40.067763 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:40.088472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ffb65-888b-41b5-a91e-f0395881efb3 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:40.094844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:40.095493 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:40.095774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:40.096049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] PATH_INFO: `/v3/users/3f44ef2f40f74bd1ab3617e05778f9b7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:40.097229 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f44ef2f40f74bd1ab3617e05778f9b7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:40.099421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:40.175103 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f44ef2f40f74bd1ab3617e05778f9b7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:40.185972 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f44ef2f40f74bd1ab3617e05778f9b7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:40.187125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f44ef2f40f74bd1ab3617e05778f9b7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:40.188005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f44ef2f40f74bd1ab3617e05778f9b7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:40.206510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f44ef2f40f74bd1ab3617e05778f9b7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:40.226951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1257/2484] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:40 2022] DELETE /identity/v3/users/3f44ef2f40f74bd1ab3617e05778f9b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:40.231377 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:40.232354 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:40.232888 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:40.272807 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:40.274309 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:40.351036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1228/2485] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:40.361845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:40.363527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:40.434020 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7458-d925-4e5c-85f7-7d85194a678a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:40.438965 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:40.439885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:40.440275 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:40.440579 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:40.451384 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:40.452813 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:40.463804 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1258/2486] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:40.941266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:40.943193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:40.958976 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6e7e5-5546-4e85-90dc-4f50b9b1e33b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:40.965527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:40.967005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:40.967517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:40.967981 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] PATH_INFO: `/v3/projects/7c4ae8f34a38453bb85e05a9ef0140ff` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:40.970432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4ae8f34a38453bb85e05a9ef0140ff)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:40.978058 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:41.055860 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4ae8f34a38453bb85e05a9ef0140ff', 'request_id': 'req-e69d6438-e48c-43c4-af51-25b483df9e7e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.062665 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4ae8f34a38453bb85e05a9ef0140ff', 'request_id': 'req-e69d6438-e48c-43c4-af51-25b483df9e7e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.073870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4ae8f34a38453bb85e05a9ef0140ff', 'request_id': 'req-e69d6438-e48c-43c4-af51-25b483df9e7e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.089424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] The token cache is being invalidate because project 7c4ae8f34a38453bb85e05a9ef0140ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:41.090386 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.091257 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e69d6438-e48c-43c4-af51-25b483df9e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.093825 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1229/2487] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:40 2022] DELETE /identity/v3/projects/7c4ae8f34a38453bb85e05a9ef0140ff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:41.303674 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:41.305198 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:41.326708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521346f-7554-48bf-a055-89dbb5bddce8 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:41.357847 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:41.396777 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:41.397532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:41.397917 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:41.398324 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] PATH_INFO: `/v3/users/75dae9927241406482e57b6f0a75ba1f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:41.400383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75dae9927241406482e57b6f0a75ba1f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:41.403569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:41.453728 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75dae9927241406482e57b6f0a75ba1f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.460569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75dae9927241406482e57b6f0a75ba1f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.461420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75dae9927241406482e57b6f0a75ba1f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.462000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75dae9927241406482e57b6f0a75ba1f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.476472 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75dae9927241406482e57b6f0a75ba1f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:41.489771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1259/2488] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:41 2022] DELETE /identity/v3/users/75dae9927241406482e57b6f0a75ba1f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:41.493837 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:41.494327 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:41.494494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:41.514857 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:41.516059 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:41.535630 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:41.577920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1230/2489] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:41.587758 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:41.589310 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:41.663435 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50e3c2-da29-4c6f-a514-8b25f5dd22b7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:41.669158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:41.669885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:41.670266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:41.670602 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:41.682195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:41.683818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:41.701483 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1260/2490] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:41.943433 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:41.945005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:41.958105 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177d223-d12a-46f7-88f4-67061c3df35a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:41.963467 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:41.964094 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:41.964376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:41.964688 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] PATH_INFO: `/v3/projects/ca904f036bdf4798ab50df67b76ff378` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:41.965990 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca904f036bdf4798ab50df67b76ff378)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:41.968522 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:42.027886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca904f036bdf4798ab50df67b76ff378', 'request_id': 'req-f97e237a-aeee-4d49-83d2-843351e53d2d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.034804 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca904f036bdf4798ab50df67b76ff378', 'request_id': 'req-f97e237a-aeee-4d49-83d2-843351e53d2d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.044358 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca904f036bdf4798ab50df67b76ff378', 'request_id': 'req-f97e237a-aeee-4d49-83d2-843351e53d2d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.061008 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] The token cache is being invalidate because project ca904f036bdf4798ab50df67b76ff378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:42.061378 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.062214 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.077045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1231/2491] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:41 2022] DELETE /identity/v3/projects/ca904f036bdf4798ab50df67b76ff378 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:42.755827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:42.757880 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:42.772136 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818298bc-279e-4ec5-898a-2b993c25986a service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:42.815868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:42.829166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:42.829796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:42.830074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:42.830346 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] PATH_INFO: `/v3/users/be16189fa09d4c70b600601d941e31fb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:42.831459 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be16189fa09d4c70b600601d941e31fb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:42.833421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:42.880891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be16189fa09d4c70b600601d941e31fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.887753 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be16189fa09d4c70b600601d941e31fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.888419 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be16189fa09d4c70b600601d941e31fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.889051 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be16189fa09d4c70b600601d941e31fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.900885 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-370af3c7-c7cd-4ebe-a153-08caa53eb035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be16189fa09d4c70b600601d941e31fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:42.914060 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1261/2492] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:42 2022] DELETE /identity/v3/users/be16189fa09d4c70b600601d941e31fb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:43.093776 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.095318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:43.108863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e237a-aeee-4d49-83d2-843351e53d2d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.168639 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.169240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.169525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.169800 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] PATH_INFO: `/v3/projects/20cfdf13a162457a82cdd793d91973cc` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.170932 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cfdf13a162457a82cdd793d91973cc)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.172835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.218225 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cfdf13a162457a82cdd793d91973cc', 'request_id': 'req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:43.219387 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:43.225348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cfdf13a162457a82cdd793d91973cc', 'request_id': 'req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:43.232721 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cfdf13a162457a82cdd793d91973cc', 'request_id': 'req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:43.243790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] The token cache is being invalidate because project 20cfdf13a162457a82cdd793d91973cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:43.244087 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:43.244724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e1ad76d2-f5bb-4b38-b1d7-2e20b9714014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:43.246215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1232/2493] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:43 2022] DELETE /identity/v3/projects/20cfdf13a162457a82cdd793d91973cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:43.251597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d27d-f4ab-487c-8c30-0f6b224c63fd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.251901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d27d-f4ab-487c-8c30-0f6b224c63fd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.252173 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d27d-f4ab-487c-8c30-0f6b224c63fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.271941 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5bc6d27d-f4ab-487c-8c30-0f6b224c63fd None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:43.273153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5bc6d27d-f4ab-487c-8c30-0f6b224c63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:43.333050 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1262/2494] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:43.341100 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5184-0af1-4814-9468-3efd79e07c79 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.341383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5184-0af1-4814-9468-3efd79e07c79 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.341654 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5184-0af1-4814-9468-3efd79e07c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.360936 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d78c5184-0af1-4814-9468-3efd79e07c79 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:43.362149 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d78c5184-0af1-4814-9468-3efd79e07c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:43.369890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1233/2495] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:43.374601 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6d27d-f4ab-487c-8c30-0f6b224c63fd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.384094 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6d27d-f4ab-487c-8c30-0f6b224c63fd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.389309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.389908 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.390182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.390448 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.391084 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:43.391400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.393166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.405284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1263/2496] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:18:43.409680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c5184-0af1-4814-9468-3efd79e07c79 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.419892 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c5184-0af1-4814-9468-3efd79e07c79 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.424412 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.425019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.425300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.425569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.426189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.428065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.455129 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1234/2497] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:43 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:43.459226 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.469503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f1016-e550-4cca-9f89-2c819c12b230 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.518172 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:43.525954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.526944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.527415 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.527698 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.529030 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.531380 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.552253 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1264/2498] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:43 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:43.556517 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.566742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c919-0c31-44a5-9b3f-b8fed698b9ba admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.571376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.571996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.572273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.572544 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.573215 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.574798 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.584815 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1235/2499] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:43.588536 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.599062 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be083eb-b9f8-4390-a2db-e29f8e44fb28 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.603631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe5158-5049-424e-8108-f096a2acc86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.604208 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe5158-5049-424e-8108-f096a2acc86a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.604481 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe5158-5049-424e-8108-f096a2acc86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.604749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe5158-5049-424e-8108-f096a2acc86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.605421 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe5158-5049-424e-8108-f096a2acc86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.607593 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe5158-5049-424e-8108-f096a2acc86a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.617868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1265/2500] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:43.621757 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.631974 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cafbc2-c6e6-4288-a4ad-5620fab8d9c7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.636644 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.637344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.637620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.638392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] PATH_INFO: `/v3/projects/32198ec0703f4456a7f33d79fb00df0d/users/93b0f4f2e8ec4cff8295f8fb87ff86ec/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.653286 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32198ec0703f4456a7f33d79fb00df0d, user_id=93b0f4f2e8ec4cff8295f8fb87ff86ec, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.656461 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.669488 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1236/2501] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:43 2022] PUT /identity/v3/projects/32198ec0703f4456a7f33d79fb00df0d/users/93b0f4f2e8ec4cff8295f8fb87ff86ec/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:43.681088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7efbed-2cf4-46e4-8555-67d0f64cbd0b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.681313 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7efbed-2cf4-46e4-8555-67d0f64cbd0b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.681589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7efbed-2cf4-46e4-8555-67d0f64cbd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.709417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ac7efbed-2cf4-46e4-8555-67d0f64cbd0b None None] MFA Rules not processed for user `93b0f4f2e8ec4cff8295f8fb87ff86ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:43.710639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac7efbed-2cf4-46e4-8555-67d0f64cbd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:43.774691 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1266/2502] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:43.779234 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.840931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a564e-c50f-4547-a3fe-ae5b7af01046 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.845816 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.846411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.846690 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.846961 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.847589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.849779 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.877626 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1237/2503] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:43 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:43.881736 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7efbed-2cf4-46e4-8555-67d0f64cbd0b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.892307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7efbed-2cf4-46e4-8555-67d0f64cbd0b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.947776 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.948477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.948765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.949072 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.949712 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.951631 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:43.973268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1267/2504] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:43 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:43.977266 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:43.987999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b831e9-3d9f-4fe8-a536-1593ddf8803b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:43.992505 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:43.993127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:43.993403 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:43.993719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:43.994284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:43.995879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:44.006553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1238/2505] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:44.010462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:44.021814 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e726928-e4e4-4c57-b0be-bfc7d9faa826 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:44.026427 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:44.027090 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:44.027350 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:44.027616 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] PATH_INFO: `/v3/projects/378200116c614acfad310f44e4d4a6dc/users/a20b4b2b7924446da5e5e3ed921ed131/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:44.043049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] RBAC: Authorizing `identity:create_grant(project_id=378200116c614acfad310f44e4d4a6dc, user_id=a20b4b2b7924446da5e5e3ed921ed131, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:44.046382 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:44.059870 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1268/2506] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:44 2022] PUT /identity/v3/projects/378200116c614acfad310f44e4d4a6dc/users/a20b4b2b7924446da5e5e3ed921ed131/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:44.063908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:44.074912 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c4e5-94d0-4c18-aeff-d8ee46090386 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:44.120683 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:44.133803 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280db26-db9c-4ceb-8b78-ba03d5fe58de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:44.134407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280db26-db9c-4ceb-8b78-ba03d5fe58de admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:44.134709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280db26-db9c-4ceb-8b78-ba03d5fe58de admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:44.134980 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280db26-db9c-4ceb-8b78-ba03d5fe58de admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:44.135612 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280db26-db9c-4ceb-8b78-ba03d5fe58de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:44.137227 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280db26-db9c-4ceb-8b78-ba03d5fe58de admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:44.146841 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1239/2507] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:44.151140 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:44.161675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b257b-20d7-4af3-930c-3351060a400b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:44.166129 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:44.166770 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:44.167044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:44.167312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] PATH_INFO: `/v3/projects/378200116c614acfad310f44e4d4a6dc/users/a20b4b2b7924446da5e5e3ed921ed131/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:44.169871 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378200116c614acfad310f44e4d4a6dc, user_id=a20b4b2b7924446da5e5e3ed921ed131, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:44.172479 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:44.182491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1269/2508] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:44 2022] PUT /identity/v3/projects/378200116c614acfad310f44e4d4a6dc/users/a20b4b2b7924446da5e5e3ed921ed131/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:44.192547 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa468e-2d05-4c64-bb0c-2b91bb48e640 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:44.192834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa468e-2d05-4c64-bb0c-2b91bb48e640 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:44.193142 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa468e-2d05-4c64-bb0c-2b91bb48e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:44.220478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eaaa468e-2d05-4c64-bb0c-2b91bb48e640 None None] MFA Rules not processed for user `a20b4b2b7924446da5e5e3ed921ed131`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:44.221643 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eaaa468e-2d05-4c64-bb0c-2b91bb48e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:44.287393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1240/2509] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:44.299042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:44.300771 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:44.319171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:44.358010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e806b-fe44-463e-be98-e8a28fd89875 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:44.361594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fbf5-8f6f-42f9-973d-6efbfbb00fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:44.362185 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fbf5-8f6f-42f9-973d-6efbfbb00fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:44.362460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fbf5-8f6f-42f9-973d-6efbfbb00fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:44.362725 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fbf5-8f6f-42f9-973d-6efbfbb00fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:44.371317 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fbf5-8f6f-42f9-973d-6efbfbb00fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:44.372759 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fbf5-8f6f-42f9-973d-6efbfbb00fd0 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:44.381994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1270/2510] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:44.761425 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa468e-2d05-4c64-bb0c-2b91bb48e640 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:44.822724 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa468e-2d05-4c64-bb0c-2b91bb48e640 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:44.827312 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:44.827928 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:44.828209 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:44.828482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] PATH_INFO: `/v3/users/93b0f4f2e8ec4cff8295f8fb87ff86ec` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:44.829602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b0f4f2e8ec4cff8295f8fb87ff86ec)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:44.831506 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:44.879060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b0f4f2e8ec4cff8295f8fb87ff86ec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:44.879691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b0f4f2e8ec4cff8295f8fb87ff86ec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:44.886635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b0f4f2e8ec4cff8295f8fb87ff86ec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:44.887261 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b0f4f2e8ec4cff8295f8fb87ff86ec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:44.899280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b0f4f2e8ec4cff8295f8fb87ff86ec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:44.900439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:44.914607 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1241/2511] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:44 2022] DELETE /identity/v3/users/93b0f4f2e8ec4cff8295f8fb87ff86ec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:44.919354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:44.919826 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:44.919955 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:44.939482 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:44.940669 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:45.001224 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1271/2512] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:45.010764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:45.012318 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:45.069289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e02e-4c95-4c74-83e5-a746ad4c7032 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:45.072872 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:45.073499 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:45.073780 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:45.074052 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:45.083407 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:45.084823 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:45.094123 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1242/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:45.356379 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:45.357898 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:45.371516 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8fa13-7f59-4c77-80ff-c00565802843 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:45.376757 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:45.377426 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:45.377713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:45.377981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] PATH_INFO: `/v3/projects/32198ec0703f4456a7f33d79fb00df0d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:45.379122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32198ec0703f4456a7f33d79fb00df0d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:45.381061 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:45.427319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32198ec0703f4456a7f33d79fb00df0d', 'request_id': 'req-eb8907c8-e63f-4a11-a52a-98955acc4be5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.434738 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32198ec0703f4456a7f33d79fb00df0d', 'request_id': 'req-eb8907c8-e63f-4a11-a52a-98955acc4be5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.440944 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32198ec0703f4456a7f33d79fb00df0d', 'request_id': 'req-eb8907c8-e63f-4a11-a52a-98955acc4be5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.452805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] The token cache is being invalidate because project 32198ec0703f4456a7f33d79fb00df0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:45.453154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.453790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.455261 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1272/2514] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:45 2022] DELETE /identity/v3/projects/32198ec0703f4456a7f33d79fb00df0d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:45.459282 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:45.469045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b472c6-f4df-47f9-8ee9-2e1bba2d07b4 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:45.524200 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:45.524820 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:45.525134 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:45.525406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] PATH_INFO: `/v3/users/a20b4b2b7924446da5e5e3ed921ed131` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:45.526528 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20b4b2b7924446da5e5e3ed921ed131)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:45.528515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:45.573996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20b4b2b7924446da5e5e3ed921ed131'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.574559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20b4b2b7924446da5e5e3ed921ed131'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.582571 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20b4b2b7924446da5e5e3ed921ed131'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.583188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20b4b2b7924446da5e5e3ed921ed131'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.595638 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-af519cc2-ee1f-482c-95b7-0cc0a1dbccba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20b4b2b7924446da5e5e3ed921ed131'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:45.608577 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1243/2515] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:45 2022] DELETE /identity/v3/users/a20b4b2b7924446da5e5e3ed921ed131 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:45.876088 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:45.877557 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:45.890975 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8907c8-e63f-4a11-a52a-98955acc4be5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:45.933188 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:45.951460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:45.952469 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:45.952878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:45.953333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] PATH_INFO: `/v3/projects/378200116c614acfad310f44e4d4a6dc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:45.954544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=378200116c614acfad310f44e4d4a6dc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:45.956433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.005184 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378200116c614acfad310f44e4d4a6dc', 'request_id': 'req-c9218683-0d90-48d5-b361-de03c375f0ea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:46.012166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378200116c614acfad310f44e4d4a6dc', 'request_id': 'req-c9218683-0d90-48d5-b361-de03c375f0ea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:46.017638 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378200116c614acfad310f44e4d4a6dc', 'request_id': 'req-c9218683-0d90-48d5-b361-de03c375f0ea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:46.028428 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] The token cache is being invalidate because project 378200116c614acfad310f44e4d4a6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:46.028708 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:46.029348 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c9218683-0d90-48d5-b361-de03c375f0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:46.030839 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1273/2516] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:45 2022] DELETE /identity/v3/projects/378200116c614acfad310f44e4d4a6dc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:46.035627 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a640b85-29e2-4428-9baf-f129855f4413 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.035915 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a640b85-29e2-4428-9baf-f129855f4413 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.036272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a640b85-29e2-4428-9baf-f129855f4413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.057077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9a640b85-29e2-4428-9baf-f129855f4413 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:46.058268 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9a640b85-29e2-4428-9baf-f129855f4413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:46.063972 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:46.118432 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1244/2517] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:46.127168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd044-a540-4af6-a291-428a61404bfa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.127532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd044-a540-4af6-a291-428a61404bfa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.127878 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd044-a540-4af6-a291-428a61404bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.147462 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5e1dd044-a540-4af6-a291-428a61404bfa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:46.148653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5e1dd044-a540-4af6-a291-428a61404bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:46.156444 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1274/2518] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:46.160515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a640b85-29e2-4428-9baf-f129855f4413 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.170845 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a640b85-29e2-4428-9baf-f129855f4413 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.175532 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.176128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.176406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.176679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.177368 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:46.177673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.179252 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.191382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1245/2519] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:18:46.195266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd044-a540-4af6-a291-428a61404bfa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.204432 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd044-a540-4af6-a291-428a61404bfa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.209087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.209675 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.209958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.210227 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.210861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.212762 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.241383 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1275/2520] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:46.245527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.255404 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c1b11-1ac6-484b-9d13-73131ec71cb6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.310293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.310917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.311198 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.311472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.312088 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.314060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.334685 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1246/2521] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:46.338837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.349920 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eb5e2-a32c-4000-a3ae-cc65538001b1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.354679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.355284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.355565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.355840 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.356515 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.358861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.368964 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1276/2522] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:46.372723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.382635 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8026-aa71-4108-ad85-e2aa4ad46b11 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.387207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07acd0-5f28-4668-b83d-5e95db7f1d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.387795 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07acd0-5f28-4668-b83d-5e95db7f1d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.388077 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07acd0-5f28-4668-b83d-5e95db7f1d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.388351 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07acd0-5f28-4668-b83d-5e95db7f1d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.389072 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07acd0-5f28-4668-b83d-5e95db7f1d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.390682 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07acd0-5f28-4668-b83d-5e95db7f1d69 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.401174 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1247/2523] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:46.405701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.415726 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c01d27-21ad-4597-ae0c-f7b6966762d2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.421087 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.421821 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.422141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.422499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] PATH_INFO: `/v3/projects/72685b5a953643339e25e7e4d905e900/users/6dddbc392f1e4cb1811b8505eba3140f/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.437162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72685b5a953643339e25e7e4d905e900, user_id=6dddbc392f1e4cb1811b8505eba3140f, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.439815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.452544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1277/2524] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:46 2022] PUT /identity/v3/projects/72685b5a953643339e25e7e4d905e900/users/6dddbc392f1e4cb1811b8505eba3140f/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:46.463996 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdc8a-3383-47c8-a83f-b3b0c7bed2d0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.464468 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdc8a-3383-47c8-a83f-b3b0c7bed2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.464595 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdc8a-3383-47c8-a83f-b3b0c7bed2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.492891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a98bdc8a-3383-47c8-a83f-b3b0c7bed2d0 None None] MFA Rules not processed for user `6dddbc392f1e4cb1811b8505eba3140f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:46.494127 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a98bdc8a-3383-47c8-a83f-b3b0c7bed2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:46.557371 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1248/2525] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:46.561854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.622937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9d738-1fc8-400a-8788-768e87197e0f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.627626 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.628230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.628510 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.628783 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.629452 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.631365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.645500 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:46.662395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1278/2526] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:46.663502 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bdc8a-3383-47c8-a83f-b3b0c7bed2d0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.674014 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bdc8a-3383-47c8-a83f-b3b0c7bed2d0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.677513 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:46.730702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.731299 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.731575 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.731844 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.732453 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.734472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.754489 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1249/2527] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:46.758372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.769282 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b992b-79a5-4b1f-a6c5-adf646b5d37e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.774019 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.774622 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.774906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.775182 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.775816 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.777447 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.788503 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1279/2528] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:46.792275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.802406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b6e7-7004-4b16-854c-9db16fe6eeac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.807011 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660405b-a3ed-45db-8bc1-371695879d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.807589 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660405b-a3ed-45db-8bc1-371695879d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.807865 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660405b-a3ed-45db-8bc1-371695879d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.808134 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660405b-a3ed-45db-8bc1-371695879d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.808758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660405b-a3ed-45db-8bc1-371695879d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.810393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660405b-a3ed-45db-8bc1-371695879d6d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.820427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1250/2529] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:46.823994 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:46.834568 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a7f5-759c-4bb5-8af9-7c2dff29e3fa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:46.839178 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:46.839822 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.840110 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.840387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] PATH_INFO: `/v3/projects/a802f1d808ad421c85d5a80c06358bce/users/3e83a31626e740879f501ea828c9c91c/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.855314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a802f1d808ad421c85d5a80c06358bce, user_id=3e83a31626e740879f501ea828c9c91c, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:46.858040 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:46.872063 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1280/2530] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:46 2022] PUT /identity/v3/projects/a802f1d808ad421c85d5a80c06358bce/users/3e83a31626e740879f501ea828c9c91c/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:46.882276 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d3154-2811-4123-b7cc-3458b681d095 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:46.882508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d3154-2811-4123-b7cc-3458b681d095 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:46.882781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d3154-2811-4123-b7cc-3458b681d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:46.910777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-667d3154-2811-4123-b7cc-3458b681d095 None None] MFA Rules not processed for user `3e83a31626e740879f501ea828c9c91c`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:46.911992 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-667d3154-2811-4123-b7cc-3458b681d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:46.976849 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1251/2531] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:46.981284 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.043546 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b393-642d-4b0b-a2bb-ec92c15f2479 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.048158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.048751 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.049055 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.049334 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.049962 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.051843 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.078729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1281/2532] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:46 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:47.082856 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d3154-2811-4123-b7cc-3458b681d095 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.093478 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d3154-2811-4123-b7cc-3458b681d095 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.152442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.153005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.153296 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.153567 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.154195 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.156106 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.175964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1252/2533] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:47 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:47.179981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.190692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2b8d-9a5b-47cb-ba91-f3065f24a614 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.195241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.195836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.196119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.196395 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.197071 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.198657 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.209577 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1282/2534] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:47.213539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.220005 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:47.224301 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec795-2125-4a5f-a31b-b0fdda72e286 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.229661 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.230300 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.230620 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.230873 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] PATH_INFO: `/v3/projects/2708f706968943f186b0173a38c1e9b6/users/1712e75e92614c118d265caa4ff7fbbd/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.245133 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2708f706968943f186b0173a38c1e9b6, user_id=1712e75e92614c118d265caa4ff7fbbd, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.247761 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.260927 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1253/2535] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:47 2022] PUT /identity/v3/projects/2708f706968943f186b0173a38c1e9b6/users/1712e75e92614c118d265caa4ff7fbbd/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:47.265344 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.275268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859abd-1cb7-4f73-a410-2cfdd168fa4e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.330241 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8531442-bc08-4d87-85ab-2f4911ccc633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.330838 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531442-bc08-4d87-85ab-2f4911ccc633 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.331142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531442-bc08-4d87-85ab-2f4911ccc633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.331409 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531442-bc08-4d87-85ab-2f4911ccc633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.332038 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8531442-bc08-4d87-85ab-2f4911ccc633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.333681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8531442-bc08-4d87-85ab-2f4911ccc633 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.343307 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1283/2536] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:47.347411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.358255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dad8e-8d59-4d98-8c67-d2203ca92048 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.362834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.363470 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.363747 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.364017 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] PATH_INFO: `/v3/projects/2708f706968943f186b0173a38c1e9b6/users/1712e75e92614c118d265caa4ff7fbbd/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.365937 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2708f706968943f186b0173a38c1e9b6, user_id=1712e75e92614c118d265caa4ff7fbbd, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.368617 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.379771 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1254/2537] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:47 2022] PUT /identity/v3/projects/2708f706968943f186b0173a38c1e9b6/users/1712e75e92614c118d265caa4ff7fbbd/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:47.389790 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.390078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.390374 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.417299 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] MFA Rules not processed for user `1712e75e92614c118d265caa4ff7fbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:47.418410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:47.434993 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:47.487741 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1284/2538] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:47.499587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.501472 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:47.559662 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536857b5-f659-4b22-b8ff-f54ea42fe480 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.563949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.564539 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.564811 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.565110 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.573835 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.575232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.584758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1255/2539] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:47.627423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:47.628827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:47.640553 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf338-c994-48bd-bbc0-83fb7f50a52c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:47.644109 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e81c-73fd-49d7-942b-497cfc3057c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:47.644701 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e81c-73fd-49d7-942b-497cfc3057c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:47.645007 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e81c-73fd-49d7-942b-497cfc3057c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:47.645287 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e81c-73fd-49d7-942b-497cfc3057c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:47.700913 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392e81c-73fd-49d7-942b-497cfc3057c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:47.702391 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392e81c-73fd-49d7-942b-497cfc3057c3 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:47.711104 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1285/2540] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:50.573870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:50.637446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bfe0c-c942-40b9-9a4a-ff9d52a88974 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:50.642442 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:50.643070 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:50.643367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:50.643616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] PATH_INFO: `/v3/users/6dddbc392f1e4cb1811b8505eba3140f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:50.644729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dddbc392f1e4cb1811b8505eba3140f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:50.646679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:50.693693 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dddbc392f1e4cb1811b8505eba3140f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:50.695314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dddbc392f1e4cb1811b8505eba3140f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:50.702272 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dddbc392f1e4cb1811b8505eba3140f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:50.702885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dddbc392f1e4cb1811b8505eba3140f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:50.714819 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dddbc392f1e4cb1811b8505eba3140f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:50.716016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:50.730783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1256/2541] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:50 2022] DELETE /identity/v3/users/6dddbc392f1e4cb1811b8505eba3140f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:50.735372 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:50.735856 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:50.735985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:50.755319 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:50.756517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:50.814778 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1286/2542] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:50.824460 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:50.825910 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:50.884995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28731844-d6c6-41ae-9c73-713281282225 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:50.888652 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:50.889284 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:50.889563 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:50.889833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:50.899241 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:50.900669 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:50.910783 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1257/2543] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:51.183371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:51.184815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:51.197365 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638700cd-32e3-44c4-bf95-78c84dbcfabd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:51.202027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:51.202661 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:51.202936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:51.203205 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] PATH_INFO: `/v3/projects/72685b5a953643339e25e7e4d905e900` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:51.204318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72685b5a953643339e25e7e4d905e900)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:51.206359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:51.252015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:51.253442 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72685b5a953643339e25e7e4d905e900', 'request_id': 'req-5e90309f-39c8-4f8c-b386-f112bf6e6a77'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.260918 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72685b5a953643339e25e7e4d905e900', 'request_id': 'req-5e90309f-39c8-4f8c-b386-f112bf6e6a77'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.266951 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72685b5a953643339e25e7e4d905e900', 'request_id': 'req-5e90309f-39c8-4f8c-b386-f112bf6e6a77'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.278242 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] The token cache is being invalidate because project 72685b5a953643339e25e7e4d905e900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:51.278528 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.279151 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.280716 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1287/2544] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:51 2022] DELETE /identity/v3/projects/72685b5a953643339e25e7e4d905e900 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:51.284676 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:51.294298 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c7b1-2440-46e2-b11c-9dfd400f7462 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:51.350040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:51.350593 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:51.350869 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:51.351136 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] PATH_INFO: `/v3/users/3e83a31626e740879f501ea828c9c91c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:51.352226 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e83a31626e740879f501ea828c9c91c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:51.354152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:51.399785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e83a31626e740879f501ea828c9c91c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.400418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e83a31626e740879f501ea828c9c91c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.407939 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e83a31626e740879f501ea828c9c91c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.408576 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e83a31626e740879f501ea828c9c91c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.421042 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e83a31626e740879f501ea828c9c91c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.433187 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1258/2545] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:51 2022] DELETE /identity/v3/users/3e83a31626e740879f501ea828c9c91c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:51.701096 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:51.702491 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:51.716608 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90309f-39c8-4f8c-b386-f112bf6e6a77 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:51.774387 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:51.775044 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:51.775290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:51.775565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] PATH_INFO: `/v3/projects/a802f1d808ad421c85d5a80c06358bce` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:51.776676 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a802f1d808ad421c85d5a80c06358bce)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:51.778613 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:51.824559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a802f1d808ad421c85d5a80c06358bce', 'request_id': 'req-3444f431-c760-4f08-aa0c-89fe89426ddc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.832411 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a802f1d808ad421c85d5a80c06358bce', 'request_id': 'req-3444f431-c760-4f08-aa0c-89fe89426ddc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.837976 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a802f1d808ad421c85d5a80c06358bce', 'request_id': 'req-3444f431-c760-4f08-aa0c-89fe89426ddc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.849836 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] The token cache is being invalidate because project a802f1d808ad421c85d5a80c06358bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:51.850121 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.850744 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.852218 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1288/2546] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:51 2022] DELETE /identity/v3/projects/a802f1d808ad421c85d5a80c06358bce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:51.856137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:51.857557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:51.871054 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448746-0efd-4353-83ed-c2df5ea029fa admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:51.879167 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:51.929507 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:51.930155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:51.930437 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:51.930709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] PATH_INFO: `/v3/users/1712e75e92614c118d265caa4ff7fbbd` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:51.931810 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1712e75e92614c118d265caa4ff7fbbd)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:51.933758 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:51.978578 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1712e75e92614c118d265caa4ff7fbbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.979221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1712e75e92614c118d265caa4ff7fbbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.986672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1712e75e92614c118d265caa4ff7fbbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:51.987409 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1712e75e92614c118d265caa4ff7fbbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:52.001702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cac8a909-a8dc-476d-87d2-14108a1e9cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1712e75e92614c118d265caa4ff7fbbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:52.014424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1259/2547] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:51 2022] DELETE /identity/v3/users/1712e75e92614c118d265caa4ff7fbbd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:52.291141 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:52.292611 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:52.305960 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f431-c760-4f08-aa0c-89fe89426ddc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:52.362797 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:52.363429 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.363709 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.363982 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] PATH_INFO: `/v3/projects/2708f706968943f186b0173a38c1e9b6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.365189 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2708f706968943f186b0173a38c1e9b6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:52.367083 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:52.374755 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:52.414292 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2708f706968943f186b0173a38c1e9b6', 'request_id': 'req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:52.422300 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2708f706968943f186b0173a38c1e9b6', 'request_id': 'req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:52.427861 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2708f706968943f186b0173a38c1e9b6', 'request_id': 'req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:52.438837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] The token cache is being invalidate because project 2708f706968943f186b0173a38c1e9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:52.439124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:52.439743 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c7a65999-d2fa-4f8b-a679-e6f8a66162ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:52.441276 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1289/2548] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:52 2022] DELETE /identity/v3/projects/2708f706968943f186b0173a38c1e9b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:52.447158 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc4ae-4b7a-4791-8aac-78b0051be560 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.447445 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc4ae-4b7a-4791-8aac-78b0051be560 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.447717 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc4ae-4b7a-4791-8aac-78b0051be560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.467609 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e0cfc4ae-4b7a-4791-8aac-78b0051be560 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:52.468799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e0cfc4ae-4b7a-4791-8aac-78b0051be560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:52.525325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1260/2549] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:52.535633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255b1ba-378f-4278-a1f0-652a5bdcbf3a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.535922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255b1ba-378f-4278-a1f0-652a5bdcbf3a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.536200 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255b1ba-378f-4278-a1f0-652a5bdcbf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.556497 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6255b1ba-378f-4278-a1f0-652a5bdcbf3a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:52.557720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6255b1ba-378f-4278-a1f0-652a5bdcbf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:52.566183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1290/2550] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:52.570388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfc4ae-4b7a-4791-8aac-78b0051be560 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:52.580494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfc4ae-4b7a-4791-8aac-78b0051be560 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:52.585025 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:52.585616 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.585891 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.586163 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.586793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:52.587093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:52.588658 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:52.600768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1261/2551] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:52.604993 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255b1ba-378f-4278-a1f0-652a5bdcbf3a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:52.614230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255b1ba-378f-4278-a1f0-652a5bdcbf3a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:52.618868 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:52.619474 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.619987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.619987 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.620635 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:52.622621 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:52.649796 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1291/2552] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:52 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:18:52.653953 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:52.664418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f9aa6-bce8-441c-9314-329dd978b62f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:52.676320 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:52.722229 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:52.722826 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.723102 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.723642 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.724255 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:52.726314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:52.747719 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1262/2553] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:52 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:52.751696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:52.761940 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90393692-9847-4f62-a651-d4cf48786ae6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:52.767353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:52.767981 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.768259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.768550 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.769230 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:52.770809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:52.781183 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1292/2554] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:52.785035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:52.794886 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3345a8e-493f-48c4-b902-a97a22dcdf6e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:52.799392 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58c435-5df9-4b6c-821b-685c32bdcfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:52.799977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58c435-5df9-4b6c-821b-685c32bdcfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.800256 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58c435-5df9-4b6c-821b-685c32bdcfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.800526 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58c435-5df9-4b6c-821b-685c32bdcfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.801197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58c435-5df9-4b6c-821b-685c32bdcfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:52.802764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58c435-5df9-4b6c-821b-685c32bdcfb0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:52.813125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1263/2555] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:52.817017 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:52.827390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73a007-b66e-4ac2-9f63-6e83b066707e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:52.831866 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:52.832505 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.832782 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.833089 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] PATH_INFO: `/v3/projects/5eedd4855a214ee0b55599fae05f014c/users/eb9946a58d7d47bcb565d6e8ef659c7f/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.847937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eedd4855a214ee0b55599fae05f014c, user_id=eb9946a58d7d47bcb565d6e8ef659c7f, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:52.850845 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:52.862930 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1293/2556] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:52 2022] PUT /identity/v3/projects/5eedd4855a214ee0b55599fae05f014c/users/eb9946a58d7d47bcb565d6e8ef659c7f/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:52.874766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db335ef-b490-43bf-a6ce-a113aff5629e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:52.875273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db335ef-b490-43bf-a6ce-a113aff5629e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:52.875388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db335ef-b490-43bf-a6ce-a113aff5629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:52.904008 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6db335ef-b490-43bf-a6ce-a113aff5629e None None] MFA Rules not processed for user `eb9946a58d7d47bcb565d6e8ef659c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:52.905768 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6db335ef-b490-43bf-a6ce-a113aff5629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:52.968287 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1264/2557] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:52.972799 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.037910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aab7fc-fd0c-414f-8eec-09cee9286668 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.042540 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.043142 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.043416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.043681 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.044309 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.046810 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.072180 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1294/2558] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:52 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:53.077050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db335ef-b490-43bf-a6ce-a113aff5629e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.086822 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db335ef-b490-43bf-a6ce-a113aff5629e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.144233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.144838 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.145152 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.145424 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.146050 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.147966 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.168729 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1265/2559] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:53 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:53.173389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.183597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187afc-695c-481c-9188-4bc693cf9917 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.188322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.188925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.189244 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.189520 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.190162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.191774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.202267 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1295/2560] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:53.206096 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.215725 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee5c5d-a016-49c9-acd2-3dbb44e979bf admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.220791 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.221393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.221666 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.221935 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] PATH_INFO: `/v3/projects/31accaee9f3e4bbeb9c51941e4adb79a/users/61792e72f95b40b09f79a284bf36ba8f/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.234979 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:53.238292 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31accaee9f3e4bbeb9c51941e4adb79a, user_id=61792e72f95b40b09f79a284bf36ba8f, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.241667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.253895 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1266/2561] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:53 2022] PUT /identity/v3/projects/31accaee9f3e4bbeb9c51941e4adb79a/users/61792e72f95b40b09f79a284bf36ba8f/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:53.257692 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.267416 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f38e4-54e2-4534-bd6f-eb626dc05c2d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.271003 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:53.325610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20942c-6b18-485b-bb9b-f675bde58e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.326742 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20942c-6b18-485b-bb9b-f675bde58e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.327022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20942c-6b18-485b-bb9b-f675bde58e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.327323 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20942c-6b18-485b-bb9b-f675bde58e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.327954 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20942c-6b18-485b-bb9b-f675bde58e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.329567 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20942c-6b18-485b-bb9b-f675bde58e42 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.339064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1296/2562] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:53.343742 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.354367 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e77cde-2b8b-4f10-8887-3e3aaf8d263f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.359500 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.360144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.360422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.360696 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] PATH_INFO: `/v3/projects/31accaee9f3e4bbeb9c51941e4adb79a/users/61792e72f95b40b09f79a284bf36ba8f/roles/d4631e3f8b6d42e49362077c08a5acc7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.362631 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31accaee9f3e4bbeb9c51941e4adb79a, user_id=61792e72f95b40b09f79a284bf36ba8f, role_id=d4631e3f8b6d42e49362077c08a5acc7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.365293 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.375931 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1267/2563] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:53 2022] PUT /identity/v3/projects/31accaee9f3e4bbeb9c51941e4adb79a/users/61792e72f95b40b09f79a284bf36ba8f/roles/d4631e3f8b6d42e49362077c08a5acc7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:53.386649 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fa57b-b112-4015-b088-b3ddf698cbe4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.386937 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fa57b-b112-4015-b088-b3ddf698cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.387210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fa57b-b112-4015-b088-b3ddf698cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.414952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-938fa57b-b112-4015-b088-b3ddf698cbe4 None None] MFA Rules not processed for user `61792e72f95b40b09f79a284bf36ba8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:53.416143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-938fa57b-b112-4015-b088-b3ddf698cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:53.483054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1297/2564] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:53.494452 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.496137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:53.552755 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1ecf0-8936-4b5a-b6cb-aadc82f11b44 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.556420 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.557036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.557315 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.557582 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.567019 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.568464 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.578217 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1268/2565] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:53.665169 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fa57b-b112-4015-b088-b3ddf698cbe4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:53.675326 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fa57b-b112-4015-b088-b3ddf698cbe4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:53.679058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26afed-c32d-4143-95f6-0a04fc7ca80a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:53.679647 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26afed-c32d-4143-95f6-0a04fc7ca80a service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:53.679947 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26afed-c32d-4143-95f6-0a04fc7ca80a service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:53.680215 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26afed-c32d-4143-95f6-0a04fc7ca80a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:53.735565 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26afed-c32d-4143-95f6-0a04fc7ca80a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:53.737127 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26afed-c32d-4143-95f6-0a04fc7ca80a service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:53.745765 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1298/2566] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:58.418879 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:58.480125 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7d10-21a5-4e4a-a4ed-8da5036bf236 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:58.485240 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:58.485859 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:58.486137 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:58.486406 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] PATH_INFO: `/v3/users/eb9946a58d7d47bcb565d6e8ef659c7f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:58.487512 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9946a58d7d47bcb565d6e8ef659c7f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:58.489448 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:58.534334 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9946a58d7d47bcb565d6e8ef659c7f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:58.534918 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9946a58d7d47bcb565d6e8ef659c7f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:58.542057 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9946a58d7d47bcb565d6e8ef659c7f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:58.542684 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9946a58d7d47bcb565d6e8ef659c7f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:58.555207 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9946a58d7d47bcb565d6e8ef659c7f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:58.563511 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:58.568508 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1269/2567] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:58 2022] DELETE /identity/v3/users/eb9946a58d7d47bcb565d6e8ef659c7f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:58.573210 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:58.573696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:58.573815 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:58.593737 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:58.594925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:58.614752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:58.652827 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1299/2568] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:58.662587 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:58.663964 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:58.720898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07359497-5179-4cf6-98f3-d8a49985eb74 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:58.724885 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:58.725673 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:58.726045 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:58.726330 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:58.735702 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:58.737244 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:58.746872 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1270/2569] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:59.009004 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:59.010403 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:59.024547 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25419956-8197-4f1a-ac2b-faa4ebe0c67e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:59.029639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:59.030371 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.030651 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.030921 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] PATH_INFO: `/v3/projects/5eedd4855a214ee0b55599fae05f014c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.032150 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eedd4855a214ee0b55599fae05f014c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:59.034058 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:59.081572 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eedd4855a214ee0b55599fae05f014c', 'request_id': 'req-03a5745f-46ad-48fe-a8e4-46b514828152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.088499 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eedd4855a214ee0b55599fae05f014c', 'request_id': 'req-03a5745f-46ad-48fe-a8e4-46b514828152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.093934 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eedd4855a214ee0b55599fae05f014c', 'request_id': 'req-03a5745f-46ad-48fe-a8e4-46b514828152'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.104914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] The token cache is being invalidate because project 5eedd4855a214ee0b55599fae05f014c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:59.105226 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.105837 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.107354 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1300/2570] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:59 2022] DELETE /identity/v3/projects/5eedd4855a214ee0b55599fae05f014c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:59.111280 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:59.122422 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e56fcf-4a8d-41bd-88fe-25f4a3bd35c5 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:59.178145 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:59.178764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.179040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.179308 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] PATH_INFO: `/v3/users/61792e72f95b40b09f79a284bf36ba8f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.180396 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61792e72f95b40b09f79a284bf36ba8f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:59.182321 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:59.227382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61792e72f95b40b09f79a284bf36ba8f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.228021 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61792e72f95b40b09f79a284bf36ba8f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.234569 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61792e72f95b40b09f79a284bf36ba8f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.235344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61792e72f95b40b09f79a284bf36ba8f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.247156 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8b8d8901-da9c-4d63-afc0-aad2f578b54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61792e72f95b40b09f79a284bf36ba8f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.259471 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1271/2571] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:59 2022] DELETE /identity/v3/users/61792e72f95b40b09f79a284bf36ba8f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:59.526569 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:59.528122 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:59.541293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5745f-46ad-48fe-a8e4-46b514828152 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:59.597256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:59.597906 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.598153 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.598685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] PATH_INFO: `/v3/projects/31accaee9f3e4bbeb9c51941e4adb79a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.599785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31accaee9f3e4bbeb9c51941e4adb79a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:59.601717 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:59.646653 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31accaee9f3e4bbeb9c51941e4adb79a', 'request_id': 'req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.649000 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:59.654555 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31accaee9f3e4bbeb9c51941e4adb79a', 'request_id': 'req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.660958 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31accaee9f3e4bbeb9c51941e4adb79a', 'request_id': 'req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.672685 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] The token cache is being invalidate because project 31accaee9f3e4bbeb9c51941e4adb79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:59.672991 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.673633 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-57c7a769-4d7c-4207-bad7-b10a3b0fcbe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:59.675112 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1301/2572] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:59 2022] DELETE /identity/v3/projects/31accaee9f3e4bbeb9c51941e4adb79a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:59.681232 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4821cf-1922-40ba-9ded-63065586aaeb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.681748 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4821cf-1922-40ba-9ded-63065586aaeb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.681863 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4821cf-1922-40ba-9ded-63065586aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.701605 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7f4821cf-1922-40ba-9ded-63065586aaeb None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:59.702793 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7f4821cf-1922-40ba-9ded-63065586aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:59.719596 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:59.764723 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1272/2573] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:59.772562 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f485-6aed-41fe-b72a-61124d89bfc3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.772857 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f485-6aed-41fe-b72a-61124d89bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.773245 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f485-6aed-41fe-b72a-61124d89bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.793401 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cc33f485-6aed-41fe-b72a-61124d89bfc3 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:59.794640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cc33f485-6aed-41fe-b72a-61124d89bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:59.803042 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1302/2574] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:59.807169 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4821cf-1922-40ba-9ded-63065586aaeb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:59.816746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4821cf-1922-40ba-9ded-63065586aaeb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:59.821325 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:59.821917 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.822193 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.822459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.823093 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:59.823393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:59.824958 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:59.836794 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1273/2575] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:59.840892 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f485-6aed-41fe-b72a-61124d89bfc3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:59.850854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f485-6aed-41fe-b72a-61124d89bfc3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:59.855578 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:59.856171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.856451 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.856723 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.857966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:59.859869 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:59.887195 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1303/2576] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:59 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:59.891388 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:59.901486 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492816e9-fcce-4831-982f-be070538bda6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:59.956376 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:59.956965 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:59.957273 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:59.957543 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:59.958154 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:59.960063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:59.981084 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1274/2577] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:59 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:59.985774 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:59.996009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f0af-d394-4093-9ce4-65a659e7e87b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:00.000656 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:00.001279 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:00.001560 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:00.001834 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:00.002477 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:00.004075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:00.014075 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1304/2578] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:19:00.018040 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:00.027934 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dda67-bfde-4c90-9d7c-7fffed90a55a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:00.033016 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5fc50-75e0-46e2-8f66-18497697c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:00.033604 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5fc50-75e0-46e2-8f66-18497697c878 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:00.033883 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5fc50-75e0-46e2-8f66-18497697c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:00.034155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5fc50-75e0-46e2-8f66-18497697c878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:00.034788 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5fc50-75e0-46e2-8f66-18497697c878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:00.036529 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5fc50-75e0-46e2-8f66-18497697c878 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:00.047611 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1275/2579] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:19:00.051720 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:00.061390 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1cb70-59bb-4cab-8745-fcab149effee admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:00.065905 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:00.066532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:00.066808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:00.067077 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] PATH_INFO: `/v3/projects/5c0938d68df64884996bdaa950f198c8/users/f254b33931c1429a8a1dbc0177ac26f8/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:00.081589 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0938d68df64884996bdaa950f198c8, user_id=f254b33931c1429a8a1dbc0177ac26f8, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:00.084190 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:00.097966 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1305/2580] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:19:00 2022] PUT /identity/v3/projects/5c0938d68df64884996bdaa950f198c8/users/f254b33931c1429a8a1dbc0177ac26f8/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:19:00.108515 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d932-ef3e-4f9c-bc1b-33e74c4291a9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:00.108887 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d932-ef3e-4f9c-bc1b-33e74c4291a9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:00.109345 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d932-ef3e-4f9c-bc1b-33e74c4291a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:00.137553 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4f59d932-ef3e-4f9c-bc1b-33e74c4291a9 None None] MFA Rules not processed for user `f254b33931c1429a8a1dbc0177ac26f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:00.139728 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4f59d932-ef3e-4f9c-bc1b-33e74c4291a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:00.202189 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1276/2581] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:19:00.213985 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:00.215640 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:00.270875 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22df8f-84e1-4a33-8d6b-f78954290ba2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:00.274443 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94164609-07c3-4d0d-88c4-347a08a70894 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a17dda73b3ad4896a282dbd1b4cc8bbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:00.275036 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164609-07c3-4d0d-88c4-347a08a70894 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:00.275312 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164609-07c3-4d0d-88c4-347a08a70894 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:00.275580 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164609-07c3-4d0d-88c4-347a08a70894 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:00.284154 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94164609-07c3-4d0d-88c4-347a08a70894 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:00.285607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94164609-07c3-4d0d-88c4-347a08a70894 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:00.294139 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1306/2582] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:10.198667 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:10.290243 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=3,keystone:SELECT=59,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:20.995746 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d932-ef3e-4f9c-bc1b-33e74c4291a9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:21.096542 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d932-ef3e-4f9c-bc1b-33e74c4291a9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:21.101251 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:21.101867 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.102144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.102411 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] PATH_INFO: `/v3/users/f254b33931c1429a8a1dbc0177ac26f8` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.103557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f254b33931c1429a8a1dbc0177ac26f8)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:21.105479 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:21.151764 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f254b33931c1429a8a1dbc0177ac26f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.152418 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f254b33931c1429a8a1dbc0177ac26f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.160141 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f254b33931c1429a8a1dbc0177ac26f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.160817 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f254b33931c1429a8a1dbc0177ac26f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.173055 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f254b33931c1429a8a1dbc0177ac26f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.185796 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1277/2583] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:19:20 2022] DELETE /identity/v3/users/f254b33931c1429a8a1dbc0177ac26f8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:19:21.190527 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.191022 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.191134 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.239781 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:21.240986 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:21.301688 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1307/2584] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:21.311602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:21.313085 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:21.354417 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:21.386733 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399c76-5a86-47f9-969e-0fe563ba0823 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:21.390878 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f24e-f5f0-4cbc-a7c4-36ad28ab8d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:21.391525 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f24e-f5f0-4cbc-a7c4-36ad28ab8d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.391799 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f24e-f5f0-4cbc-a7c4-36ad28ab8d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.392063 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f24e-f5f0-4cbc-a7c4-36ad28ab8d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.400890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f24e-f5f0-4cbc-a7c4-36ad28ab8d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:21.402337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f24e-f5f0-4cbc-a7c4-36ad28ab8d3e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:21.411570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1278/2585] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:21.676910 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:21.678433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:21.692634 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dec32a-56c0-4e8d-aaac-06a07f7fccfa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:21.697501 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:21.698594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.698594 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.698825 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] PATH_INFO: `/v3/projects/5c0938d68df64884996bdaa950f198c8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.699749 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0938d68df64884996bdaa950f198c8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:21.701768 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:21.749143 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0938d68df64884996bdaa950f198c8', 'request_id': 'req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.756314 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0938d68df64884996bdaa950f198c8', 'request_id': 'req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.762045 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0938d68df64884996bdaa950f198c8', 'request_id': 'req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.773769 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] The token cache is being invalidate because project 5c0938d68df64884996bdaa950f198c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:19:21.774054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.774673 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-56a4036e-7de3-4856-a6ff-0fc0a9afe0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:21.776147 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1308/2586] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:19:21 2022] DELETE /identity/v3/projects/5c0938d68df64884996bdaa950f198c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:19:21.781637 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198e91-c974-469c-92b3-5efdf7d710d4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.781922 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198e91-c974-469c-92b3-5efdf7d710d4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.782197 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198e91-c974-469c-92b3-5efdf7d710d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.830032 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f8198e91-c974-469c-92b3-5efdf7d710d4 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:21.831233 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f8198e91-c974-469c-92b3-5efdf7d710d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:21.891527 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1279/2587] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:19:21.899171 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f642ff4-e2c4-46d4-8ef9-039a3ab4b06a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.899466 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f642ff4-e2c4-46d4-8ef9-039a3ab4b06a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.899766 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f642ff4-e2c4-46d4-8ef9-039a3ab4b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.919066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9f642ff4-e2c4-46d4-8ef9-039a3ab4b06a None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:21.920246 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f642ff4-e2c4-46d4-8ef9-039a3ab4b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:21.928556 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1309/2588] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:21.932557 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198e91-c974-469c-92b3-5efdf7d710d4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:21.942889 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198e91-c974-469c-92b3-5efdf7d710d4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:21.947443 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:21.948036 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.948317 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.948592 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.949310 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:19:21.949641 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:21.951265 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:21.962701 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1280/2589] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:19:21.966854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f642ff4-e2c4-46d4-8ef9-039a3ab4b06a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:21.976293 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f642ff4-e2c4-46d4-8ef9-039a3ab4b06a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:21.980901 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:21.981532 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:21.981812 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:21.982085 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:21.982713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:21.985114 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:22.011818 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1310/2590] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:19:21 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:19:22.015735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:22.025562 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af43bc-5f05-4530-a8a1-34458da69915 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:22.082001 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:22.082599 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:22.082877 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:22.083146 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:22.083756 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:22.085686 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:22.106434 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1281/2591] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:19:22 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:19:22.111166 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:22.122423 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119545e-2098-4465-87dc-c747309bebd7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:22.127199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:22.127798 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:22.128078 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:22.128349 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:22.129002 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:22.130610 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:22.140417 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1311/2592] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:19:22.144393 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:22.154570 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea639b-c82a-4134-bc65-afea7750acb1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:22.159698 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba58550-d070-4b9e-b823-8c064a2c0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:22.160446 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba58550-d070-4b9e-b823-8c064a2c0c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:22.160833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba58550-d070-4b9e-b823-8c064a2c0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:22.161139 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba58550-d070-4b9e-b823-8c064a2c0c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:22.161777 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba58550-d070-4b9e-b823-8c064a2c0c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:22.163381 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba58550-d070-4b9e-b823-8c064a2c0c48 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:22.177735 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1282/2593] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:19:22.178833 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:22.188644 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca801f3-bee4-4568-b745-e4b5925bbb3c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:22.193302 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:22.193956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:22.194236 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:22.194509 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] PATH_INFO: `/v3/projects/ef4e1c4c0d614813b6db3436b7a495ba/users/212fafd25c8148739317240ecdde2ff2/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:22.209005 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4e1c4c0d614813b6db3436b7a495ba, user_id=212fafd25c8148739317240ecdde2ff2, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:22.211670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:22.213953 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:22.227931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1312/2594] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:19:22 2022] PUT /identity/v3/projects/ef4e1c4c0d614813b6db3436b7a495ba/users/212fafd25c8148739317240ecdde2ff2/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:19:22.238989 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259331-81d8-4eb8-b9f0-ae59c810d980 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:22.239290 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259331-81d8-4eb8-b9f0-ae59c810d980 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:22.239552 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259331-81d8-4eb8-b9f0-ae59c810d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:22.253117 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:22.268015 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-84259331-81d8-4eb8-b9f0-ae59c810d980 None None] MFA Rules not processed for user `212fafd25c8148739317240ecdde2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:22.269262 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-84259331-81d8-4eb8-b9f0-ae59c810d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:22.335155 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1283/2595] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:22.347203 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:22.349521 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:22.411158 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5c1b6-ddd2-49ab-9dfa-be64dff5b925 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:22.415274 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469cce0-a6e3-445b-a927-ae930c833d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:22.415888 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469cce0-a6e3-445b-a927-ae930c833d25 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:22.416170 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469cce0-a6e3-445b-a927-ae930c833d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:22.416460 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469cce0-a6e3-445b-a927-ae930c833d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:22.426679 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469cce0-a6e3-445b-a927-ae930c833d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:22.428130 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469cce0-a6e3-445b-a927-ae930c833d25 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:22.437561 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1313/2596] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:32.332221 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=29 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:32.433009 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:32.622459 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259331-81d8-4eb8-b9f0-ae59c810d980 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:32.684144 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259331-81d8-4eb8-b9f0-ae59c810d980 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:32.689075 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:32.689697 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:32.689971 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:32.690239 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] PATH_INFO: `/v3/users/212fafd25c8148739317240ecdde2ff2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:32.691337 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=212fafd25c8148739317240ecdde2ff2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:32.693288 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:32.739530 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212fafd25c8148739317240ecdde2ff2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:32.740180 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212fafd25c8148739317240ecdde2ff2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:32.747560 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212fafd25c8148739317240ecdde2ff2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:32.748153 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212fafd25c8148739317240ecdde2ff2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:32.760495 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212fafd25c8148739317240ecdde2ff2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:32.773269 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1284/2597] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:19:32 2022] DELETE /identity/v3/users/212fafd25c8148739317240ecdde2ff2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:19:32.777808 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:32.778093 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:32.778376 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:32.797296 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:32.798489 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:32.856199 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1314/2598] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:32.866434 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:32.867890 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:32.925679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e915-190a-4531-8b83-6aae129f4c16 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:32.929313 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571fc0f-b02c-41ad-b536-a9b49fb70009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:32.929949 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571fc0f-b02c-41ad-b536-a9b49fb70009 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:32.930220 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571fc0f-b02c-41ad-b536-a9b49fb70009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:32.930494 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571fc0f-b02c-41ad-b536-a9b49fb70009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:32.939457 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571fc0f-b02c-41ad-b536-a9b49fb70009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:32.940870 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571fc0f-b02c-41ad-b536-a9b49fb70009 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:32.950275 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1285/2599] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:33.206433 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.207848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:33.222119 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9dd-b4fb-4f13-910d-2f58e8459baa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.227266 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.227915 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.229162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.229162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] PATH_INFO: `/v3/projects/ef4e1c4c0d614813b6db3436b7a495ba` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.231956 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4e1c4c0d614813b6db3436b7a495ba)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.234066 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.282952 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4e1c4c0d614813b6db3436b7a495ba', 'request_id': 'req-f985db7d-e926-49a7-ade1-57adf1d168f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:33.290039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4e1c4c0d614813b6db3436b7a495ba', 'request_id': 'req-f985db7d-e926-49a7-ade1-57adf1d168f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:33.295471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4e1c4c0d614813b6db3436b7a495ba', 'request_id': 'req-f985db7d-e926-49a7-ade1-57adf1d168f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:33.306639 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] The token cache is being invalidate because project ef4e1c4c0d614813b6db3436b7a495ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:19:33.306925 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:33.307559 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f985db7d-e926-49a7-ade1-57adf1d168f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:33.309059 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1315/2600] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:19:33 2022] DELETE /identity/v3/projects/ef4e1c4c0d614813b6db3436b7a495ba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:19:33.314000 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65e9e-4aac-444f-8228-56c9d2853595 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.314319 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65e9e-4aac-444f-8228-56c9d2853595 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.314613 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65e9e-4aac-444f-8228-56c9d2853595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.334170 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-70c65e9e-4aac-444f-8228-56c9d2853595 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:33.335353 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-70c65e9e-4aac-444f-8228-56c9d2853595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:33.353046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:33.398051 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1286/2601] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:33.462425 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a555e4-4d53-4ebb-876c-d7f095638f0b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.462980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a555e4-4d53-4ebb-876c-d7f095638f0b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.462980 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a555e4-4d53-4ebb-876c-d7f095638f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.483018 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-49a555e4-4d53-4ebb-876c-d7f095638f0b None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:33.484235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49a555e4-4d53-4ebb-876c-d7f095638f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:33.492054 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1316/2602] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:33.496211 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65e9e-4aac-444f-8228-56c9d2853595 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.506427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65e9e-4aac-444f-8228-56c9d2853595 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.510923 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.511509 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.511785 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.512060 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.512691 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:19:33.513013 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.514590 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.526295 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1287/2603] 10.222.0.25 () {58 vars in 1153 bytes} [Sun Oct 23 02:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:19:33.530396 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a555e4-4d53-4ebb-876c-d7f095638f0b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.539436 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a555e4-4d53-4ebb-876c-d7f095638f0b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.544025 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.544612 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.544936 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.545237 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.545854 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.547713 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.574370 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1317/2604] 10.222.0.25 () {60 vars in 1153 bytes} [Sun Oct 23 02:19:33 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:19:33.579049 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.588920 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cad24-5609-4fbf-8fc9-872541e05cc3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.643834 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.644426 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.644709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.644995 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.645633 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.647550 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.668065 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1288/2605] 10.222.0.25 () {60 vars in 1144 bytes} [Sun Oct 23 02:19:33 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:19:33.672400 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.682694 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bedce-c9d0-4e26-9763-3fa464d2cb17 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.687844 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.688805 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.689471 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.689891 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.690539 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.692125 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.702064 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1318/2606] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:19:33.706572 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.716766 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f678-e27e-40c9-8506-2122e745e191 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.721462 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557c544-d304-42b1-bd75-c5f845b53e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.722095 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c544-d304-42b1-bd75-c5f845b53e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.722373 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c544-d304-42b1-bd75-c5f845b53e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.722903 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557c544-d304-42b1-bd75-c5f845b53e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.723573 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557c544-d304-42b1-bd75-c5f845b53e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.725258 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557c544-d304-42b1-bd75-c5f845b53e90 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.736898 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1289/2607] 10.222.0.25 () {58 vars in 1122 bytes} [Sun Oct 23 02:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:19:33.740359 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.750974 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7974def-84f2-4fe6-b713-b2cfcda7368f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.755729 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.756422 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.756702 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.756998 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] PATH_INFO: `/v3/projects/03e2b905a5984d71b4ec7f7f4a71f8f9/users/390805f7bb024caab113cbe703f0ee60/roles/ebb01267d6294a78b508f59cff01b63b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.771259 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e2b905a5984d71b4ec7f7f4a71f8f9, user_id=390805f7bb024caab113cbe703f0ee60, role_id=ebb01267d6294a78b508f59cff01b63b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.773914 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.786597 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1319/2608] 10.222.0.25 () {60 vars in 1483 bytes} [Sun Oct 23 02:19:33 2022] PUT /identity/v3/projects/03e2b905a5984d71b4ec7f7f4a71f8f9/users/390805f7bb024caab113cbe703f0ee60/roles/ebb01267d6294a78b508f59cff01b63b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:19:33.797099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0593e3-ff2b-4f7d-bcf3-3468d52ace8b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.797385 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0593e3-ff2b-4f7d-bcf3-3468d52ace8b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.797657 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0593e3-ff2b-4f7d-bcf3-3468d52ace8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.825699 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4e0593e3-ff2b-4f7d-bcf3-3468d52ace8b None None] MFA Rules not processed for user `390805f7bb024caab113cbe703f0ee60`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:33.826914 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4e0593e3-ff2b-4f7d-bcf3-3468d52ace8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:33.892781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1290/2609] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:33.903389 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:33.905070 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:33.926889 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:33.963517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f046-685a-422a-8c2d-fa07b9c582c6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:33.967256 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05553db-c149-40f0-82e5-d7267c965679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f681d888b56c4fea8acd271e1d51ae3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:33.967809 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05553db-c149-40f0-82e5-d7267c965679 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:33.968091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05553db-c149-40f0-82e5-d7267c965679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:33.968364 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05553db-c149-40f0-82e5-d7267c965679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:33.977015 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05553db-c149-40f0-82e5-d7267c965679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:33.978453 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05553db-c149-40f0-82e5-d7267c965679 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:33.987628 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1320/2610] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:43.889476 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:43.983128 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=17 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:43.999128 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0593e3-ff2b-4f7d-bcf3-3468d52ace8b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:44.059710 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0593e3-ff2b-4f7d-bcf3-3468d52ace8b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:44.064162 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:44.064781 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:44.065086 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:44.065360 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] PATH_INFO: `/v3/users/390805f7bb024caab113cbe703f0ee60` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:44.066482 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390805f7bb024caab113cbe703f0ee60)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:44.068383 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:44.114140 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390805f7bb024caab113cbe703f0ee60'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.114805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390805f7bb024caab113cbe703f0ee60'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.122311 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390805f7bb024caab113cbe703f0ee60'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.122924 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390805f7bb024caab113cbe703f0ee60'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.135080 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390805f7bb024caab113cbe703f0ee60'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.147760 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1291/2611] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:19:43 2022] DELETE /identity/v3/users/390805f7bb024caab113cbe703f0ee60 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:19:44.152194 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:44.152480 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:44.152752 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:44.172049 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] MFA Rules not processed for user `f9e56f541ea740a1989e45c1dc0e8565`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:44.173268 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:44.230091 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1321/2612] 10.222.0.25 () {58 vars in 958 bytes} [Sun Oct 23 02:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:19:44.239650 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:44.241083 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:44.317399 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a81e32-352a-48e1-949a-b240a011eb35 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:44.320943 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc28ef7b36746208560692b17809e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:44.321559 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:44.321832 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:44.322099 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:44.330790 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:44.332738 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:44.341999 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1292/2613] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:19:44.601678 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:44.603074 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:44.617696 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da7a4f-2358-4ce9-b7c3-54f921261f58 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:44.623144 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:44.623780 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:44.624167 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:44.624322 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] PATH_INFO: `/v3/projects/03e2b905a5984d71b4ec7f7f4a71f8f9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:44.625476 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e2b905a5984d71b4ec7f7f4a71f8f9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:44.627385 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:44.673343 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e2b905a5984d71b4ec7f7f4a71f8f9', 'request_id': 'req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.683715 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e2b905a5984d71b4ec7f7f4a71f8f9', 'request_id': 'req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.689161 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e2b905a5984d71b4ec7f7f4a71f8f9', 'request_id': 'req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.700711 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] The token cache is being invalidate because project 03e2b905a5984d71b4ec7f7f4a71f8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:19:44.701027 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.701670 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:19:44.703168 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1322/2614] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:19:44 2022] DELETE /identity/v3/projects/03e2b905a5984d71b4ec7f7f4a71f8f9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:19:54.337866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:54.697853 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:19.709967 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:19.711397 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:19.801602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f162e17-afbf-4307-bc98-5356838f8ff7 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:19.860866 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:19.861503 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:19.861778 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:19.862047 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:19.863773 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:19.875035 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:19.876618 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:19.886602 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1293/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:20:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:20:29.882267 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=67 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:50.571258 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:50.572795 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:50.640333 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a5ca-ffb2-4e56-882c-8d161fab1f2d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:50.645648 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:50.646331 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:50.646607 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:50.646877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] PATH_INFO: `/v3/users/40f3d602872246a69642449bb792abcf` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:50.647996 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f3d602872246a69642449bb792abcf)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:50.650010 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:50.701517 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f3d602872246a69642449bb792abcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:50.709363 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f3d602872246a69642449bb792abcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:50.710031 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f3d602872246a69642449bb792abcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:50.710623 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f3d602872246a69642449bb792abcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:50.723352 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f3d602872246a69642449bb792abcf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:50.736785 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1323/2616] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:20:50 2022] DELETE /identity/v3/users/40f3d602872246a69642449bb792abcf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:20:50.909382 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:50.922172 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5a02f-57ca-48c2-9d01-4120c7f301aa service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:50.981439 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:50.982067 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:50.982348 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:50.982625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] PATH_INFO: `/v3/projects/e51bde1b62a04fae93be245b132e6412` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:50.983720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51bde1b62a04fae93be245b132e6412)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:50.985679 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:51.030977 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51bde1b62a04fae93be245b132e6412', 'request_id': 'req-ca80ff24-4754-4e99-8e5d-418d0410b18b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.036579 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51bde1b62a04fae93be245b132e6412', 'request_id': 'req-ca80ff24-4754-4e99-8e5d-418d0410b18b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.043680 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51bde1b62a04fae93be245b132e6412', 'request_id': 'req-ca80ff24-4754-4e99-8e5d-418d0410b18b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.055427 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] The token cache is being invalidate because project e51bde1b62a04fae93be245b132e6412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:20:51.055716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.056344 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.057871 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1294/2617] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:20:50 2022] DELETE /identity/v3/projects/e51bde1b62a04fae93be245b132e6412 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:20:51.062124 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:51.063530 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:51.077014 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff946788-bfc8-4948-a5e6-413ca8caab07 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:51.132877 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:51.133544 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:51.133824 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:51.134097 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] PATH_INFO: `/v3/users/57629c4e2ff245529affa92e43d22c21` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:51.135219 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=57629c4e2ff245529affa92e43d22c21)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:51.137511 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:51.159353 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:51.185318 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57629c4e2ff245529affa92e43d22c21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.192650 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57629c4e2ff245529affa92e43d22c21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.193325 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57629c4e2ff245529affa92e43d22c21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.193931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57629c4e2ff245529affa92e43d22c21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.205420 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57629c4e2ff245529affa92e43d22c21'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.220039 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1324/2618] 10.222.0.25 () {58 vars in 1224 bytes} [Sun Oct 23 02:20:51 2022] DELETE /identity/v3/users/57629c4e2ff245529affa92e43d22c21 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:20:51.386709 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:51.388314 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:51.401625 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80ff24-4754-4e99-8e5d-418d0410b18b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:51.458716 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e56f541ea740a1989e45c1dc0e8565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f5af6c6d2bb4361a1d4b7374821b416', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:51.459349 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:51.459632 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:51.459908 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] PATH_INFO: `/v3/projects/a924e9c86a934dc2824d9ff92dacee62` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:51.461046 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a924e9c86a934dc2824d9ff92dacee62)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:51.462956 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:51.497188 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:51.512672 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a924e9c86a934dc2824d9ff92dacee62', 'request_id': 'req-ab47b636-618d-4456-ba73-62f2cbafc149'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.518196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a924e9c86a934dc2824d9ff92dacee62', 'request_id': 'req-ab47b636-618d-4456-ba73-62f2cbafc149'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.525516 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a924e9c86a934dc2824d9ff92dacee62', 'request_id': 'req-ab47b636-618d-4456-ba73-62f2cbafc149'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.536805 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] The token cache is being invalidate because project a924e9c86a934dc2824d9ff92dacee62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:20:51.537196 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.537833 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab47b636-618d-4456-ba73-62f2cbafc149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:51.539289 dv-cinder-861491-5-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1295/2619] 10.222.0.25 () {58 vars in 1233 bytes} [Sun Oct 23 02:20:51 2022] DELETE /identity/v3/projects/a924e9c86a934dc2824d9ff92dacee62 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:21:01.216235 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:01.533720 dv-cinder-861491-5-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:25.628863 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:25.630265 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:25.699290 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876ec37-0fd7-4430-a9cd-a035413490ab admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:25.756928 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcabdb-b81a-4ddf-aa00-b81ee1c9b8f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c398dc49ac8241aab3112a5ac879b2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '326d23431da14b53b9d6bf3660131ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:25.757584 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcabdb-b81a-4ddf-aa00-b81ee1c9b8f6 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:25.757848 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcabdb-b81a-4ddf-aa00-b81ee1c9b8f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:25.758118 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcabdb-b81a-4ddf-aa00-b81ee1c9b8f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:25.759922 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64bcabdb-b81a-4ddf-aa00-b81ee1c9b8f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:25.771704 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcabdb-b81a-4ddf-aa00-b81ee1c9b8f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:25.773410 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcabdb-b81a-4ddf-aa00-b81ee1c9b8f6 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:25.783162 dv-cinder-861491-5-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1325/2620] 10.222.0.25 () {60 vars in 1365 bytes} [Sun Oct 23 02:25:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:25:35.778931 dv-cinder-861491-5-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=58 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}